-- Logs begin at Tue 2022-05-10 19:16:42 UTC, end at Tue 2022-05-10 21:02:49 UTC. -- May 10 20:07:25.377605 dv-cinder-828805-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 20:07:25.386623 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:07:25 2022] *** May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: nodename: dv-cinder-828805-2-iscsi May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: machine: x86_64 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: clock source: unix May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: pcre jit disabled May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: detected number of CPU cores: 4 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: current working directory: / May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: detected binary path: /usr/bin/uwsgi-core May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: your processes number limit is 47680 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: your memory page size is 4096 bytes May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: detected max file descriptor number: 2048 May 10 20:07:25.388601 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: lock engine: pthread robust mutexes May 10 20:07:25.389556 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: thunder lock: enabled May 10 20:07:25.389556 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 20:07:25.389556 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:07:25.442763 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: Python main interpreter initialized at 0x563b212679c0 May 10 20:07:25.442763 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: python threads support enabled May 10 20:07:25.442763 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: your server socket listen backlog is limited to 100 connections May 10 20:07:25.442763 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: your mercy for graceful operations on workers is 90 seconds May 10 20:07:25.443085 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:07:25.443188 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: *** Operational MODE: preforking *** May 10 20:07:25.443459 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: *** uWSGI is running in multiple interpreter mode *** May 10 20:07:25.443459 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: spawned uWSGI master process (pid: 103381) May 10 20:07:25.443661 dv-cinder-828805-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 20:07:25.444438 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: spawned uWSGI worker 1 (pid: 103382, cores: 1) May 10 20:07:25.444614 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: spawned uWSGI worker 2 (pid: 103383, cores: 1) May 10 20:07:25.444787 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:07:26.650282 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:07:26.711099 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:07:27.378206 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:07:27.378206 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: from cryptography.utils import int_from_bytes May 10 20:07:27.378520 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:07:27.378520 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: from cryptography.utils import int_from_bytes May 10 20:07:27.419925 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:07:27.419925 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: from cryptography.utils import int_from_bytes May 10 20:07:27.420290 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:07:27.420290 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: from cryptography.utils import int_from_bytes May 10 20:07:30.016570 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:07:30.017144 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:07:30.017503 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:07:30.017599 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:07:30.017688 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:07:30.017774 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:07:30.017866 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:07:30.017954 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:07:30.018040 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:07:30.018164 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:07:30.018358 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.018461 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.018690 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.018784 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019017 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019111 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019345 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019444 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019681 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019775 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.019993 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020089 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020316 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020410 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020637 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020732 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.020964 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021136 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021270 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021366 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021533 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021624 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021860 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-2-iscsi {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.021954 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-2-iscsi {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.022210 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.022310 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.022522 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.022614 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.022840 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023004 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023162 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023257 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023469 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023559 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023795 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.023887 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.024103 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.024198 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.024602 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.024714 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025048 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025174 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025359 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025478 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025674 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.025798 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026013 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026178 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026353 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026446 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026667 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026772 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.026988 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027079 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027397 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027625 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027762 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.027937 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028023 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028334 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-2-iscsi {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028416 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-2-iscsi {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028652 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028743 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.028968 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.029059 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.029286 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.029371 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.029699 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.029878 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030012 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030124 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030352 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030446 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030674 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030768 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.030999 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031083 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031310 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031400 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031666 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031759 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.031991 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032083 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032310 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032402 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032633 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032720 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.032938 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033024 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033248 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033343 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033558 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033643 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033877 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.033962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034207 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034314 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034519 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034613 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034771 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.034864 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035081 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035179 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035402 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035499 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035725 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.035821 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036047 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036146 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036288 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036379 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036537 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036637 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036855 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.036941 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037177 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037270 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037491 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037589 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037799 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.037883 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038123 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038213 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038435 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038535 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038743 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.038839 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039048 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039143 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039357 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039452 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039664 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039750 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.039984 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040075 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040387 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040620 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040711 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.040928 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041024 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041248 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041345 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041649 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041745 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041901 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.041986 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042238 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042328 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042579 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042665 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.042994 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043211 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043303 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043529 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043614 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.043946 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044159 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044253 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044467 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044559 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044775 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.044870 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045096 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045189 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045421 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045506 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045727 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045825 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.045981 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046076 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046305 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046391 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046616 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046715 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.046936 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.047031 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.047775 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.047874 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048094 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048188 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048408 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048494 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048717 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.048805 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049030 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049123 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049342 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049443 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049654 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049746 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.049965 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050059 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050298 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050392 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050607 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050692 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.050915 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051002 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051224 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051310 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051532 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051653 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.051856 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.052020 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.052178 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.052614 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.053675 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054234 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054322 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054413 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054503 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054593 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054678 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054770 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054865 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.054951 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055031 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055109 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055197 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055277 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055370 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055456 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055537 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055615 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055698 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055785 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055873 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.055959 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056038 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056123 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056208 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056393 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056491 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056698 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.056793 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057007 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057094 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057324 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057427 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057632 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057718 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.057949 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058034 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058279 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058374 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058588 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058675 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058895 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.058987 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059202 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059289 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059509 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059595 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059814 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.059910 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060114 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060200 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060416 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060501 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060738 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.060832 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061044 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061129 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061352 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061440 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061659 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061758 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.061971 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.062058 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.062322 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:07:30.062410 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.062655 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.062764 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.063554 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.063652 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.063878 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.063967 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064212 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064307 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064548 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064642 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064871 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.064955 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065187 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065275 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065502 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065593 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065822 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.065907 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066163 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066268 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066485 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066622 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066802 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.066901 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067121 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067214 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067441 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067535 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067761 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.067860 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068089 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068185 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068412 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068497 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068729 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.068827 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069047 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069135 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069362 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069448 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069686 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.069783 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070009 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070154 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070350 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070438 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070667 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.070763 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071014 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071109 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071331 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071418 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071659 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071793 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.071983 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072070 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072300 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072394 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072616 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072712 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.072933 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073021 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073248 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073335 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073580 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073667 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073898 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.073985 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074244 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074343 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074562 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074650 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074879 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.074973 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075196 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075292 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075513 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075600 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075825 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.075911 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076141 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076234 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076466 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076552 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076786 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.076876 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077101 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077198 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077418 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077505 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077745 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.077844 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.078049 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.078179 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.078387 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.078480 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079214 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079303 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079525 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079622 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079841 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.079981 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080150 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080243 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080457 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080618 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.080861 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.081095 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.081182 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.081406 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.081500 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.081987 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082149 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082321 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082408 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082642 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082730 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.082959 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083053 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083276 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083364 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083586 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083675 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083897 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.083986 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084210 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084303 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084520 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084608 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084829 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.084914 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085150 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085244 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085461 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085549 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085771 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.085856 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086100 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086202 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086416 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086511 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086725 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.086810 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087042 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087136 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087358 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087444 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087671 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087755 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.087985 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088084 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088304 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088399 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088618 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088706 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.088934 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089023 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089249 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089334 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089591 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089686 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.089994 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090249 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090352 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090577 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090662 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.090987 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091208 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091296 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091516 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091602 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091823 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.091917 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092131 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092261 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092437 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092531 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092745 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.092841 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093050 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093146 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093358 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093457 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093665 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093751 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.093972 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.094057 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.094847 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.094949 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095179 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095267 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095496 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095584 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095804 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.095900 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096113 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096199 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096420 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096512 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096728 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.096822 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097066 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097150 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097375 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097469 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097723 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.097811 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098048 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098165 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098401 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098487 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098716 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.098803 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099038 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099125 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099352 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099437 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099670 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099757 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.099983 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100067 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100298 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100395 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100615 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100703 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.100931 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101245 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101340 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101559 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101644 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101875 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.101967 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102216 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102371 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102537 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102623 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102845 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.102937 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103159 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103263 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103489 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103583 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103823 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.103908 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104144 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104239 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104469 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104555 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104781 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.104865 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105100 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105194 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105413 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105507 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105726 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.105812 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106039 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106144 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106395 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106481 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106713 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.106800 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107038 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107127 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107357 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107443 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107681 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107769 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.107997 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108085 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108311 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108397 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108628 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108722 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.108933 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109017 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109249 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109342 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109572 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109668 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.109929 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110023 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110268 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110356 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110587 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110761 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110902 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.110988 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111214 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111529 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111628 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111846 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.111931 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112157 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112258 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112464 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112562 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112771 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.112860 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113086 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113171 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113403 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113490 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113719 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.113805 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114029 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114176 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114367 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114457 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114678 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114765 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.114989 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115077 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115297 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115391 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115606 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115694 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.115923 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116024 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116236 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116322 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116549 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116634 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116873 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.116971 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117183 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117273 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117489 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117578 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117796 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.117890 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118144 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118235 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118454 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118542 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118762 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.118861 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119066 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119152 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119372 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119458 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119714 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.119818 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120025 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120113 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120331 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120424 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120657 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120746 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.120969 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121055 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121286 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121379 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121599 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121687 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.121913 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122000 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122257 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122347 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122580 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122678 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122895 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.122981 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123209 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123294 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123525 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123614 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123839 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.123933 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124153 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124249 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124467 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124565 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124780 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.124865 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125094 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125191 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125444 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125543 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125752 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.125844 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126062 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126200 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126404 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126490 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126729 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.126978 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.127293 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.127390 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.127630 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.127726 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.127952 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128048 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128276 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128363 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128598 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128691 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.128925 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129013 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129259 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129345 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129590 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129675 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.129913 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130013 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130256 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130354 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130572 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130668 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130883 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.130976 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131197 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131291 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131507 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131601 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131814 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.131899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132122 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132207 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132431 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132518 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132741 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.132849 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133048 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133142 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133356 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133442 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133667 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133754 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.133974 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134059 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134305 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134396 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134624 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134711 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.134933 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135096 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135240 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135327 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135562 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135648 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135871 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.135967 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136177 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136264 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136482 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136569 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136788 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.136887 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137127 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137219 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137437 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137530 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137780 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.137877 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138133 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138225 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138449 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138542 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138761 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.138856 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139080 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139167 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139386 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139479 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139696 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.139784 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140003 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140089 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140312 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140416 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140625 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.140718 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.141466 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.141567 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.141808 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.141905 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142148 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142237 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142468 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142555 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142788 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.142910 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143096 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143185 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143404 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143506 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143711 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.143812 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144115 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144337 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144435 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144650 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144750 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.144959 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145057 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145269 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145356 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145580 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145668 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145889 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.145983 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146223 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146314 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146531 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146619 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146838 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.146924 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147147 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147232 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147458 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147546 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147765 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.147852 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148074 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148169 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148391 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148486 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148698 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.148785 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149005 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149100 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149327 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149637 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149725 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.149944 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150049 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150280 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150383 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150589 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150676 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150897 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.150998 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151203 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151289 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151521 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151612 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151842 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.151987 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152154 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152254 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152460 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152548 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152767 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.152913 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153075 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153162 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153381 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153467 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153687 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153775 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.153992 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154095 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154326 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154425 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154633 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154776 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.154938 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155024 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155243 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155328 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155547 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155635 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155874 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.155968 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.156179 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.156273 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.156485 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.156592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.157345 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.157433 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.157666 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.157765 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.157989 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.158075 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.158344 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.158431 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.158687 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.158782 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159009 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159103 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159331 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159419 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159645 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159742 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.159960 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160046 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160275 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160368 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160587 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160684 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160894 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.160981 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161214 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161526 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161613 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161833 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.161927 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162164 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162264 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162478 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162567 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162797 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.162890 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163209 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163432 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163527 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163758 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.163852 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164088 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164177 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164401 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164489 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164712 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.164837 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165028 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165189 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165340 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165428 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165653 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165738 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.165965 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166059 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166311 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166399 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166626 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166713 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.166942 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167043 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167259 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167345 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167573 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167658 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167883 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.167976 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168193 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168287 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168512 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168597 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168824 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.168919 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169133 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169226 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169457 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169543 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169771 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.169859 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170204 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170417 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170506 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170731 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.170818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171040 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171128 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171350 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171475 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171784 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.171872 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172102 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172206 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172442 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172539 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172761 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.172849 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173080 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173212 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173397 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173497 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173714 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.173801 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174027 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174132 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174364 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174490 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174803 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.174897 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175117 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175202 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175432 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175526 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175749 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.175845 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176059 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176146 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176371 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176460 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176687 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176774 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.176997 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177082 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177310 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177398 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177620 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177744 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.177932 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178019 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178289 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178379 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178604 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178691 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.178932 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179092 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179356 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179445 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179678 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179773 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.179993 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.180122 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.180417 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.180505 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.180738 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.180825 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181058 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181156 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181384 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181470 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181712 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.181798 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182021 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182153 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182366 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182468 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182684 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.182770 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183004 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183092 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183333 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183439 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183649 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183738 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.183969 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184056 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184278 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184373 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184618 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184711 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.184920 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185002 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185328 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185557 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185643 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185886 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.185973 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.186316 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.186417 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.186637 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.186725 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.186965 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187052 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187294 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187387 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187604 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187690 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.187943 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188033 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188257 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188568 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188656 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188879 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.188974 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189194 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189282 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189504 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189591 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189821 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.189916 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190161 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190252 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190481 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190575 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190791 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.190892 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191102 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191188 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191417 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191505 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191726 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.191821 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192050 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192366 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192454 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192687 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.192775 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193012 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193097 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193337 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193471 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193649 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193748 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.193964 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194050 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194299 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194388 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194623 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194752 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.194936 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195070 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195250 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195419 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195601 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195731 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.195916 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196059 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196246 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196394 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196584 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196726 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.196918 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197039 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197234 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197378 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197575 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197708 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.197908 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198029 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198258 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198387 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198589 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198720 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.198926 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199021 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199235 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199332 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199546 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199634 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199863 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.199958 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200173 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200269 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200483 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200578 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200793 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.200884 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201109 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201205 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201416 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201504 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201724 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.201811 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202031 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202148 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202370 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202459 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202680 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202766 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.202998 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.203104 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.203308 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.203395 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204243 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204446 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204532 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204754 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.204847 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205088 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205182 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205399 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205485 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205733 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.205818 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.206052 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.206223 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.206405 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.206491 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.206979 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207118 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207401 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207660 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207760 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.207954 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208050 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208277 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208366 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208598 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208685 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.208920 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209009 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209240 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209328 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209557 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209644 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209869 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.209963 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210210 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210313 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210527 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210614 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210844 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.210930 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.211172 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.211367 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.211698 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.211785 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212020 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212120 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212338 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212434 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212656 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212761 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.212971 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213065 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213288 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213375 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213605 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213690 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.213918 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214106 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214261 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214349 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214578 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214666 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214893 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.214981 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215221 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215307 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215551 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215637 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215884 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.215972 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216203 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216299 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216523 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216611 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216840 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.216929 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217157 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217243 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217481 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217606 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217821 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.217917 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218150 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218262 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218470 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218563 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218793 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.218885 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.219158 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.219250 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.219968 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220064 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220285 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220376 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220601 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220692 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.220917 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221008 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221232 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221323 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221548 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221640 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221865 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.221958 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222205 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222308 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222528 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222631 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222862 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.222952 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223185 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223275 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223503 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223601 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223819 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.223906 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.224136 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.224270 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.224457 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.224659 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.224981 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225067 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225299 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225387 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225636 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225723 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.225964 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226051 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226306 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226402 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226629 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226724 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.226954 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227044 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227260 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227346 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227570 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227658 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227885 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.227973 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228201 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228293 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228506 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228593 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228812 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.228899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229141 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229237 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229446 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229531 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229752 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.229845 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.230070 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.230201 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.230410 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.230626 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.230947 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231042 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231284 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231379 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231610 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231697 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.231936 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232024 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232260 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232360 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232572 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232660 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232882 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.232981 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233197 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233292 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233507 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233650 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233818 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.233906 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234153 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234256 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234477 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234566 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234814 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.234904 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235129 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235228 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235444 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235576 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235757 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.235848 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236065 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236153 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236374 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236460 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236683 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.236777 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237101 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237312 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237400 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237621 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237720 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.237928 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238015 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238259 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238348 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238571 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238668 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.238959 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239061 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239193 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239289 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239503 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239600 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239811 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.239898 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240119 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240205 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240427 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240515 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240735 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.240822 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241043 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241130 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241351 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241438 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241668 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.241756 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242016 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242174 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242355 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242445 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242666 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242756 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.242975 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243069 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243295 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243391 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243610 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243705 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.243928 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244022 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244242 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244329 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244565 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244652 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244897 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.244992 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.245224 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.245438 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.245762 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.245851 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246124 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246228 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246445 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246540 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246786 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.246882 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247098 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247192 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247412 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247507 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247721 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.247816 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248034 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248124 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248355 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248442 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248672 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248758 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.248988 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249076 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249304 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249397 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249618 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249705 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.249942 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250052 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250283 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250378 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250625 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250731 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.250940 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251031 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251257 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251347 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251571 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251743 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251888 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.251982 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252207 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252297 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252529 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252628 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252860 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.252950 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253184 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253272 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253504 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253822 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.253908 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254159 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254263 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254478 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254568 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254793 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.254880 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255104 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255190 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255417 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255504 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255740 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.255827 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256055 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256142 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256369 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256460 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256690 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.256784 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257096 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257191 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257417 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257505 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.257838 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258056 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258189 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258397 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258486 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258728 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.258816 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259056 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259145 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259361 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259449 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259676 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.259763 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260000 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260088 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260332 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260427 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260661 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260747 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.260992 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261081 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261303 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261391 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261613 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261707 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.261921 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262008 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262254 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262355 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262573 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262671 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262884 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.262970 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263196 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263283 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263503 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263598 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263812 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.263908 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264120 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264205 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264428 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264523 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264736 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.264825 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265043 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265129 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265354 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265450 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265658 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.265745 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.266511 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.266651 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.266827 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.266927 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267137 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267227 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267445 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267534 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267754 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.267843 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268065 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268153 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268371 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268458 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268678 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268766 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.268982 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269068 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269289 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269375 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269594 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269681 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269900 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.269990 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.270310 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.270412 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.270637 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.270725 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.270966 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271066 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271282 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271378 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271595 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271681 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271908 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.271994 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272225 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272342 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272549 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272643 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272869 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.272996 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273185 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273274 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273504 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273593 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273821 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.273907 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274164 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274257 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274481 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274578 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274797 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.274883 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275114 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275203 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275427 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275513 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275745 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.275841 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276071 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276166 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276383 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276471 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276692 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.276787 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277020 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277341 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277428 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277660 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277805 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.277975 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278063 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278318 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278405 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278636 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278739 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.278953 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279041 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279268 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279353 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279579 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279666 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.279891 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280014 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280210 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280298 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280529 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280617 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280848 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.280934 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.281176 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.281269 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.281504 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.282192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.282403 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.282492 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.282738 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.282840 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283055 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283142 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283394 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283482 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283724 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.283820 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284041 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284129 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284359 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284446 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284669 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284766 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.284917 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:07:30.285007 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:07:30.285216 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:07:30.308018 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.309656 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_db.sqlalchemy.engines [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.372153 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.context [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af367fc0-4f9a-4803-8740-8f77fd786c48(cell1) {{(pid=103382) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:07:30.373628 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.context [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af367fc0-4f9a-4803-8740-8f77fd786c48(cell1) {{(pid=103383) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:07:30.376558 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:30.378150 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:30.378946 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:30.379843 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_concurrency.lockutils [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:30.380904 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:30.381548 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_concurrency.lockutils [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:30.382430 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_concurrency.lockutils [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:30.384728 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_concurrency.lockutils [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:30.392224 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.395441 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.399823 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_db.sqlalchemy.engines [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.403865 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_db.sqlalchemy.engines [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.553736 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.563739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG oslo_db.sqlalchemy.engines [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:07:30.949827 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:07:30.957380 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:07:30.996754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: WARNING keystonemiddleware.auth_token [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:07:31.006489 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: WARNING keystonemiddleware.auth_token [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:07:31.302846 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:07:31.308822 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:07:31.314973 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b212679c0 pid: 103382 (default app) May 10 20:07:31.316991 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:07:31.318190 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 May 10 20:07:31.318607 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Tue May 10 20:07:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:07:31.349089 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: WARNING keystonemiddleware.auth_token [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:07:31.356237 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: WARNING keystonemiddleware.auth_token [None req-f4b9fa6f-8441-4528-a753-e1400e6f19bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:07:31.361910 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b212679c0 pid: 103383 (default app) May 10 20:08:53.190310 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:53.191291 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 10 20:08:53.191682 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:53.627378 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-0802c37f-4500-4067-86a3-e14ff94494ab admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:53.657807 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-0802c37f-4500-4067-86a3-e14ff94494ab admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459227 May 10 20:08:53.664935 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 20:08:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:08:55.948170 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:55.949840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-24baffd6-897b-41cd-95e9-2a67c957fc31 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 May 10 20:08:55.950276 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:56.007899 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-c0bc3258-4c01-4898-8583-c217c5af19af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:56.030031 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:08:56.030031 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: warnings.warn(msg) May 10 20:08:56.119490 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-c0bc3258-4c01-4898-8583-c217c5af19af admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.163158 May 10 20:08:56.121119 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:08:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:08:56.343660 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-1437dbe5-3cb2-4c3a-9475-64ebe794be60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:56.346046 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:08:56.346046 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:08:56.455365 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-1437dbe5-3cb2-4c3a-9475-64ebe794be60 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.326541 May 10 20:08:56.456296 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 20:08:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:58.778029 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-c0bc3258-4c01-4898-8583-c217c5af19af admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:58.779080 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-c0bc3258-4c01-4898-8583-c217c5af19af admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 May 10 20:08:58.779497 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:58.883930 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-00f98f0f-61b0-4eae-a152-4c85d8d3fb75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:58.902641 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:08:58.902641 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:08:58.988476 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-00f98f0f-61b0-4eae-a152-4c85d8d3fb75 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.202933 May 10 20:08:58.989113 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:08:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:08:59.001509 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-63d2883a-c8f7-4f4d-9e1c-4064e39a5af5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:59.003166 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:08:59.003166 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: warnings.warn(msg) May 10 20:08:59.127366 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-63d2883a-c8f7-4f4d-9e1c-4064e39a5af5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129458 May 10 20:08:59.127966 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 20:08:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:01.480611 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-00f98f0f-61b0-4eae-a152-4c85d8d3fb75 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:01.482389 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-00f98f0f-61b0-4eae-a152-4c85d8d3fb75 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 May 10 20:09:01.491427 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:01.545615 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-0af48025-7984-4b61-a85e-c220fbf963d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:01.648607 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-0af48025-7984-4b61-a85e-c220fbf963d2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159716 May 10 20:09:01.649529 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:01.663652 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-eb636175-a334-4d1a-a4f3-61acdc0595be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:01.741460 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-eb636175-a334-4d1a-a4f3-61acdc0595be admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083810 May 10 20:09:01.742238 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 20:09:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:04.030640 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-0af48025-7984-4b61-a85e-c220fbf963d2 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:04.031653 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-0af48025-7984-4b61-a85e-c220fbf963d2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 10 20:09:04.032059 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:04.091771 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-36e11163-f5f2-42d6-b150-529d8cbca41b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:04.185354 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-36e11163-f5f2-42d6-b150-529d8cbca41b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147180 May 10 20:09:04.185918 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:04.197561 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-f51791f4-9782-4fc7-9f5f-eda064decfd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:04.274971 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-f51791f4-9782-4fc7-9f5f-eda064decfd7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080729 May 10 20:09:04.275571 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 20:09:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:06.541016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-36e11163-f5f2-42d6-b150-529d8cbca41b admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:06.542698 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-36e11163-f5f2-42d6-b150-529d8cbca41b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 10 20:09:06.543097 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:06.601800 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4, "ram": 4096}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:06.663788 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.115131 May 10 20:09:06.664558 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:06.676524 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-0c7d16e7-7a8e-4241-9491-c2e37adbdfea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:06.742267 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-0c7d16e7-7a8e-4241-9491-c2e37adbdfea admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069184 May 10 20:09:06.743221 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 20:09:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:09.052315 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:09.053334 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 10 20:09:09.053740 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:09.113831 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d45ee23d-70a6-4ef8-9a3f-85c5e4e04b98 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:09.140260 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d45ee23d-70a6-4ef8-9a3f-85c5e4e04b98 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079368 May 10 20:09:09.141861 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 20:09:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:09:11.845321 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:11.846380 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-275d0794-cbd9-4767-8f35-9adde8cbb67a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 20:09:11.846792 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:11.918008 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-94b44331-9412-4b21-b999-2b61bc4c26ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:11.999446 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-94b44331-9412-4b21-b999-2b61bc4c26ce admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146465 May 10 20:09:12.000011 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:12.013613 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-90b0a6fb-7537-4e29-9d13-00b22b5867b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:12.100491 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-90b0a6fb-7537-4e29-9d13-00b22b5867b0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091761 May 10 20:09:12.100946 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 20:09:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:14.945737 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-94b44331-9412-4b21-b999-2b61bc4c26ce admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:14.947091 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-94b44331-9412-4b21-b999-2b61bc4c26ce admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 May 10 20:09:14.947621 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:15.007909 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-c2ee026a-1857-4207-812d-73f9f798fe92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "id": "2"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:15.092885 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-c2ee026a-1857-4207-812d-73f9f798fe92 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137678 May 10 20:09:15.093608 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:15.108672 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-1b4967c5-41fa-420d-ae4e-64321e77c2ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:15.187195 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-1b4967c5-41fa-420d-ae4e-64321e77c2ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083810 May 10 20:09:15.188534 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 20:09:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:17.682460 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-c2ee026a-1857-4207-812d-73f9f798fe92 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:17.683412 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-c2ee026a-1857-4207-812d-73f9f798fe92 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 May 10 20:09:17.683821 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:17.741949 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-675d1139-bb33-4c4c-b859-4b80031c1ceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:17.816621 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-675d1139-bb33-4c4c-b859-4b80031c1ceb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.126841 May 10 20:09:17.817204 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:17.829748 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-f2b6ecea-2c86-4e7c-ae43-a85d3c5c2873 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:17.910792 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-f2b6ecea-2c86-4e7c-ae43-a85d3c5c2873 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084662 May 10 20:09:17.911381 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 20:09:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:20.178848 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-675d1139-bb33-4c4c-b859-4b80031c1ceb admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:20.179851 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-675d1139-bb33-4c4c-b859-4b80031c1ceb admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 May 10 20:09:20.180414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:09:20.240809 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-1b69a258-891c-4da2-a1a8-005a0a94a7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:20.322772 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-1b69a258-891c-4da2-a1a8-005a0a94a7e6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135738 May 10 20:09:20.323312 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:20.335336 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-b7372509-fbda-4ca7-b8de-25aae37d28cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:20.444001 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-b7372509-fbda-4ca7-b8de-25aae37d28cf admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112303 May 10 20:09:20.444705 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 20:09:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:22.714673 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-1b69a258-891c-4da2-a1a8-005a0a94a7e6 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:22.716265 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-1b69a258-891c-4da2-a1a8-005a0a94a7e6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 May 10 20:09:22.716857 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:22.776773 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:22.870231 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.147213 May 10 20:09:22.870990 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 20:09:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:22.882845 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-a5e0461e-58ba-4528-9352-4e42fde5cf89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:22.981866 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-a5e0461e-58ba-4528-9352-4e42fde5cf89 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102588 May 10 20:09:22.982858 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 20:09:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:47.013776 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:47.014847 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 10 20:09:47.015243 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:09:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:47.071941 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-58c024c1-7e63-4878-bc9f-58f346aa6786 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:47.089132 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-58c024c1-7e63-4878-bc9f-58f346aa6786 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067915 May 10 20:09:47.089656 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 20:09:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:09:48.087096 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:48.088101 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-07618ba0-7717-4d15-b6e3-e6491318c65d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 May 10 20:09:48.088502 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:48.311191 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-6a290689-a289-4da7-bf0c-576f59524c39 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.wsgi [None req-6a290689-a289-4da7-bf0c-576f59524c39 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-6a290689-a289-4da7-bf0c-576f59524c39 admin admin] Request method failure captured: May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept: application/json May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept-Encoding: gzip, deflate May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Connection: keep-alive May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Content-Length: 0 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Host: 10.222.0.65 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-Api-Version: compute 2.90 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-System-Scope: None May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: User-Agent: python-novaclient May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Auth-Token: gAAAAABiesaMV-WUFD54Pt6uJtyBGyZQFXV3X4kZ1jZdhLux_g7pbXDc3-U70q9FhO13WKy_kXmEE4lsjWTi8ta2727V_-ysYP3QeIhgn2nE1jmiEBExYxbfS5wEUQXs4gmGtCilNIjcsVgn9Nz5sD_mF8WmtyYxLCzrPQnLN1oTb_Emh9Kuqq8 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Id: None May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Name: None May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Identity-Status: Confirmed May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Is-Admin-Project: True May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Id: default May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Name: Default May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Name: admin May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Role: admin,member,reader May 10 20:09:48.321322 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Roles: admin,member,reader May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant: admin May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Name: admin May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User: admin May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Id: default May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Name: Default May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Name: admin May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: method: > May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: exception: Flavor 42 could not be found. May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: action_args: {'id': '42'} May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:48.323344 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:48.324592 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:48.325818 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-6a290689-a289-4da7-bf0c-576f59524c39 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:48.326993 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-6a290689-a289-4da7-bf0c-576f59524c39 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060823 May 10 20:09:48.326993 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 20:09:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:09:48.332083 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-32d50b15-1d9a-47c3-9c12-8848571abcb4 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:48.354244 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-32d50b15-1d9a-47c3-9c12-8848571abcb4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025660 May 10 20:09:48.354783 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:09:48.364997 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-e5078ec2-5cf8-4839-8dae-ad9523f7d425 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:48.386965 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-e5078ec2-5cf8-4839-8dae-ad9523f7d425 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025549 May 10 20:09:48.387490 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:09:48.396631 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2d71237b-60cf-46f0-ba20-8d60b716d056 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:48.402193 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-2d71237b-60cf-46f0-ba20-8d60b716d056 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2d71237b-60cf-46f0-ba20-8d60b716d056 admin admin] Request method failure captured: May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept: application/json May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Connection: keep-alive May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Content-Length: 0 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Host: 10.222.0.65 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABiesaMV-WUFD54Pt6uJtyBGyZQFXV3X4kZ1jZdhLux_g7pbXDc3-U70q9FhO13WKy_kXmEE4lsjWTi8ta2727V_-ysYP3QeIhgn2nE1jmiEBExYxbfS5wEUQXs4gmGtCilNIjcsVgn9Nz5sD_mF8WmtyYxLCzrPQnLN1oTb_Emh9Kuqq8 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Id: None May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Name: None May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Name: admin May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Role: admin,member,reader May 10 20:09:48.405414 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Roles: admin,member,reader May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant: admin May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User: admin May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Name: admin May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: method: > May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: exception: Flavor 42 could not be found. May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: action_args: {'id': '42'} May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:48.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:48.407962 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:48.409103 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2d71237b-60cf-46f0-ba20-8d60b716d056 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:48.410131 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-2d71237b-60cf-46f0-ba20-8d60b716d056 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013730 May 10 20:09:48.410131 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 20:09:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 20:09:49.290697 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-e5078ec2-5cf8-4839-8dae-ad9523f7d425 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:49.291709 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-e5078ec2-5cf8-4839-8dae-ad9523f7d425 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 10 20:09:49.292111 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:49.479112 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2def4ad7-193e-48db-b956-48a34c12f19f admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:49.484582 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-2def4ad7-193e-48db-b956-48a34c12f19f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2def4ad7-193e-48db-b956-48a34c12f19f admin admin] Request method failure captured: May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept: application/json May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Connection: keep-alive May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Content-Length: 0 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Host: 10.222.0.65 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABiesaN_CEGVTJo-h_yfAoOn9mCnye6az6fzqm6OLIvZfRl2ofudG2ZybIG3CHfXKEs6hRRsQlKWfI90uuSvh5fh_aGxcWzzTOUb8Sa0mfULSjK5k9LepT9saVT5VgvOA0zaqL-dsY2Pc-wOUUpG4xeqzQ3fuhcIgXwwMZzfTSsrX4a1f0 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Id: None May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Name: None May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Name: admin May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Role: admin,member,reader May 10 20:09:49.486107 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Roles: admin,member,reader May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant: admin May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User: admin May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Name: admin May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: method: > May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: exception: Flavor 84 could not be found. May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: action_args: {'id': '84'} May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:49.487770 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:49.488767 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:49.490140 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2def4ad7-193e-48db-b956-48a34c12f19f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:49.491388 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-2def4ad7-193e-48db-b956-48a34c12f19f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060116 May 10 20:09:49.491388 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 20:09:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:09:49.497169 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-6f7e4aa2-da76-4390-9fb0-41370cf964b2 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:49.511195 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-6f7e4aa2-da76-4390-9fb0-41370cf964b2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017497 May 10 20:09:49.511662 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:09:49.523319 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-080e98f3-8411-4b07-a500-948b3f05adb8 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:49.544451 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-080e98f3-8411-4b07-a500-948b3f05adb8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026525 May 10 20:09:49.545262 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:09:49.555406 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-e1544e52-277d-43eb-8b99-b69ef85e4839 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:49.561127 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.wsgi [None req-e1544e52-277d-43eb-8b99-b69ef85e4839 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-e1544e52-277d-43eb-8b99-b69ef85e4839 admin admin] Request method failure captured: May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept: application/json May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept-Encoding: gzip, deflate May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Connection: keep-alive May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Content-Length: 0 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Host: 10.222.0.65 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-Api-Version: compute 2.90 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-System-Scope: None May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: User-Agent: python-novaclient May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Auth-Token: gAAAAABiesaN_CEGVTJo-h_yfAoOn9mCnye6az6fzqm6OLIvZfRl2ofudG2ZybIG3CHfXKEs6hRRsQlKWfI90uuSvh5fh_aGxcWzzTOUb8Sa0mfULSjK5k9LepT9saVT5VgvOA0zaqL-dsY2Pc-wOUUpG4xeqzQ3fuhcIgXwwMZzfTSsrX4a1f0 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Id: None May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Name: None May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Identity-Status: Confirmed May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Is-Admin-Project: True May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Id: default May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Name: Default May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Name: admin May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Role: admin,member,reader May 10 20:09:49.563192 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Roles: admin,member,reader May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant: admin May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Name: admin May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User: admin May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Id: default May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Name: Default May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Name: admin May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: method: > May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: exception: Flavor 84 could not be found. May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: action_args: {'id': '84'} May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:49.564739 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:49.565754 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:49.567239 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-e1544e52-277d-43eb-8b99-b69ef85e4839 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:49.568540 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-e1544e52-277d-43eb-8b99-b69ef85e4839 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013439 May 10 20:09:49.568540 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 20:09:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:09:50.442440 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-080e98f3-8411-4b07-a500-948b3f05adb8 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:50.443438 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-080e98f3-8411-4b07-a500-948b3f05adb8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 10 20:09:50.443836 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:50.629411 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-eb1484cd-967f-4954-b6ad-d907fdb3e6a0 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:50.635135 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.wsgi [None req-eb1484cd-967f-4954-b6ad-d907fdb3e6a0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-eb1484cd-967f-4954-b6ad-d907fdb3e6a0 admin admin] Request method failure captured: May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept: application/json May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Accept-Encoding: gzip, deflate May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Connection: keep-alive May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Content-Length: 0 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Host: 10.222.0.65 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-Api-Version: compute 2.90 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Openstack-System-Scope: None May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: User-Agent: python-novaclient May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Auth-Token: gAAAAABiesaO-yiylEollEmzoGMVBVxPjpODXKYPswqLhA4-701S2kvp8HgEH9T-8RboRZiogEeYZEa3R6ELq7XHuyH2_vp1HQLjEtGwfwNdn5lCfkA5akZYOwY24CZAlg9pZqBgkT0eua816PNSfNJAZb9E3TyRP4sTZs6aQXpEfbvwx_DlfB0 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Id: None May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Domain-Name: None May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Identity-Status: Confirmed May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Is-Admin-Project: True May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Id: default May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Domain-Name: Default May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Project-Name: admin May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Role: admin,member,reader May 10 20:09:50.636627 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Roles: admin,member,reader May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant: admin May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-Tenant-Name: admin May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User: admin May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Id: default May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Domain-Name: Default May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: X-User-Name: admin May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: method: > May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: exception: Flavor 451 could not be found. May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: action_args: {'id': '451'} May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:50.638003 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:50.638850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: ERROR nova.api.openstack.wsgi May 10 20:09:50.639923 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-eb1484cd-967f-4954-b6ad-d907fdb3e6a0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:50.640966 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-eb1484cd-967f-4954-b6ad-d907fdb3e6a0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059846 May 10 20:09:50.640966 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:09:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:09:50.647728 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-93297055-6941-4dbd-bb5c-ed86a26fd01c admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:50.661796 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-93297055-6941-4dbd-bb5c-ed86a26fd01c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017628 May 10 20:09:50.662329 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:09:50.672372 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:50.685777 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017054 May 10 20:09:50.686408 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 20:09:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:09:50.695461 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-5f712224-ae0b-4736-a51a-11f3b7c40144 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:50.702230 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-5f712224-ae0b-4736-a51a-11f3b7c40144 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-5f712224-ae0b-4736-a51a-11f3b7c40144 admin admin] Request method failure captured: May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept: application/json May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Connection: keep-alive May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Content-Length: 0 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Host: 10.222.0.65 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABiesaO-yiylEollEmzoGMVBVxPjpODXKYPswqLhA4-701S2kvp8HgEH9T-8RboRZiogEeYZEa3R6ELq7XHuyH2_vp1HQLjEtGwfwNdn5lCfkA5akZYOwY24CZAlg9pZqBgkT0eua816PNSfNJAZb9E3TyRP4sTZs6aQXpEfbvwx_DlfB0 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Id: None May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Domain-Name: None May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Id: 475f061ace89472aa69923909a044007 May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Project-Name: admin May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Role: admin,member,reader May 10 20:09:50.703840 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Roles: admin,member,reader May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/475f061ace89472aa69923909a044007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/475f061ace89472aa69923909a044007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_475f061ace89472aa69923909a044007", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant: admin May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Id: 475f061ace89472aa69923909a044007 May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User: admin May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Id: 729fa49ea5f943b2b09c35b636e34ee5 May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: X-User-Name: admin May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: method: > May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: exception: Flavor 451 could not be found. May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: action_args: {'id': '451'} May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:50.705247 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:50.706025 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi May 10 20:09:50.707114 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-5f712224-ae0b-4736-a51a-11f3b7c40144 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:50.708331 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-5f712224-ae0b-4736-a51a-11f3b7c40144 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013323 May 10 20:09:50.708331 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:09:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 20:09:51.594665 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:51.595674 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 10 20:09:51.596074 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:51.782649 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-cb106546-e3a7-4797-afac-31e65901da83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:51.901913 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-cb106546-e3a7-4797-afac-31e65901da83 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.169603 May 10 20:09:51.902490 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 20:09:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:52.792033 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:52.793048 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 10 20:09:52.793472 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:52.987486 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-a4a060c0-98fd-4cdb-a720-4133c870dec0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:53.083484 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-a4a060c0-98fd-4cdb-a720-4133c870dec0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.146949 May 10 20:09:53.084030 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 20:09:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:53.969726 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:53.970771 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 10 20:09:53.971172 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:54.159013 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-073103f7-5ef8-414b-b373-aa7188a93915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:54.272537 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-073103f7-5ef8-414b-b373-aa7188a93915 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.165206 May 10 20:09:54.273088 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 20:09:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:09:55.173913 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:55.174951 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 10 20:09:55.175351 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:55.372511 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-8e890115-212a-4ffa-8475-20052a13f3c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:55.450300 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-8e890115-212a-4ffa-8475-20052a13f3c6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.129295 May 10 20:09:55.450852 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 20:09:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:09:56.341677 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:56.342799 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 10 20:09:56.343197 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:56.528943 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-ddf4965e-1b6b-4568-b080-a62c28c09aae admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:56.548191 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-ddf4965e-1b6b-4568-b080-a62c28c09aae admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068833 May 10 20:09:56.548724 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Tue May 10 20:09:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:10:59.187854 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.188849 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-b3f213aa-09d4-4a5a-8075-52cfd0585e8f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 10 20:10:59.189245 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:10:59.246708 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-4c5c5be9-77a5-4589-b241-0c4d6113bb37 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.266522 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-4c5c5be9-77a5-4589-b241-0c4d6113bb37 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071111 May 10 20:10:59.267055 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:10:59.292143 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-c2dadbad-7a22-45de-ab4f-e4f79619b770 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.299680 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-c2dadbad-7a22-45de-ab4f-e4f79619b770 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011712 May 10 20:10:59.300189 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:59.311317 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-8fd1359b-abc8-4204-9e1c-e33fb0b59d94 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.319623 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-8fd1359b-abc8-4204-9e1c-e33fb0b59d94 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011614 May 10 20:10:59.320128 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:59.330778 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.338966 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011593 May 10 20:10:59.339470 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:59.350401 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-14b5fbac-1b09-4cd7-b899-1a4c0d3c0ce1 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:59.357768 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-14b5fbac-1b09-4cd7-b899-1a4c0d3c0ce1 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010915 May 10 20:10:59.358316 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 10 20:10:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:14:31.434732 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:31.435863 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 10 20:14:31.436287 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:14:31.702190 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:31.703497 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:14:31.703497 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:14:31.704716 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:31.705145 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:31.705924 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:31.706380 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:31.741645 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-aab7b33e-976d-4693-a202-e451445b257d admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152074 May 10 20:14:31.742306 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:14:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:14:32.657500 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:32.658544 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 10 20:14:32.658940 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:14:32.848367 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:32.849535 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:14:32.849535 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:14:32.850747 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:32.851206 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:32.852017 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:32.852440 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:32.871516 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-2fd5935b-0af0-4c38-bfbf-0bbbe6c7b4c8 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073954 May 10 20:14:32.871991 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:14:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:14:44.189816 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:44.190850 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 20:14:44.191250 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:14:44.380135 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:44.381303 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:14:44.381303 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:14:44.382498 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:44.382933 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:44.383713 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:44.384139 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:44.408408 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-33c94cd3-3ce6-4dac-8a84-9cda4d8ca391 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079756 May 10 20:14:44.408946 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:14:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:14:45.321476 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: DEBUG nova.api.openstack.wsgi [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] Calling method '>' {{(pid=103383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:45.322998 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: INFO nova.api.openstack.requestlog [None req-54facb79-e7c2-4cbf-ab93-3d84b6c50975 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 May 10 20:14:45.323392 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: [pid: 103383|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 20:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:14:45.512685 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:14:45.513880 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:14:45.513880 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: warnings.warn(msg) May 10 20:14:45.515088 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:45.515555 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:45.516363 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:14:45.516795 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:14:45.539199 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-dd3e1d4b-39b2-444c-b58f-ccff369ccb51 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077332 May 10 20:14:45.539670 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 20:14:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:15:44.130073 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: Tue May 10 20:15:44 2022 - graceful shutdown triggered... May 10 20:15:44.130263 dv-cinder-828805-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 20:15:44.131232 dv-cinder-828805-2-iscsi devstack@n-api.service[103382]: Gracefully killing worker 1 (pid: 103382)... May 10 20:15:44.131632 dv-cinder-828805-2-iscsi devstack@n-api.service[103383]: Gracefully killing worker 2 (pid: 103383)... May 10 20:15:45.132327 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: worker 1 buried after 1 seconds May 10 20:15:45.132327 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: worker 2 buried after 1 seconds May 10 20:15:45.132327 dv-cinder-828805-2-iscsi devstack@n-api.service[103381]: goodbye to uWSGI. May 10 20:15:45.134508 dv-cinder-828805-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 20:15:45.135101 dv-cinder-828805-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 20:15:45.137780 dv-cinder-828805-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 20:15:45.155462 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:15:45 2022] *** May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: nodename: dv-cinder-828805-2-iscsi May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: machine: x86_64 May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: clock source: unix May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: pcre jit disabled May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: detected number of CPU cores: 4 May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: current working directory: / May 10 20:15:45.169634 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: detected binary path: /usr/bin/uwsgi-core May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: your processes number limit is 47680 May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: your memory page size is 4096 bytes May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: detected max file descriptor number: 2048 May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: lock engine: pthread robust mutexes May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: thunder lock: enabled May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 20:15:45.170492 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:15:45.217732 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: Python main interpreter initialized at 0x5565858039c0 May 10 20:15:45.217732 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: python threads support enabled May 10 20:15:45.217732 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: your server socket listen backlog is limited to 100 connections May 10 20:15:45.217732 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: your mercy for graceful operations on workers is 90 seconds May 10 20:15:45.218222 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:15:45.218222 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: *** Operational MODE: preforking *** May 10 20:15:45.218459 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: *** uWSGI is running in multiple interpreter mode *** May 10 20:15:45.218459 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: spawned uWSGI master process (pid: 117736) May 10 20:15:45.218664 dv-cinder-828805-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 20:15:45.219789 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: spawned uWSGI worker 1 (pid: 117754, cores: 1) May 10 20:15:45.219789 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: spawned uWSGI worker 2 (pid: 117755, cores: 1) May 10 20:15:45.219789 dv-cinder-828805-2-iscsi devstack@n-api.service[117736]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:15:46.440039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:15:46.460111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:15:47.243233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:15:47.243233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: from cryptography.utils import int_from_bytes May 10 20:15:47.243536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:15:47.243536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: from cryptography.utils import int_from_bytes May 10 20:15:47.272574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:15:47.272574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: from cryptography.utils import int_from_bytes May 10 20:15:47.272973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:15:47.272973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: from cryptography.utils import int_from_bytes May 10 20:15:49.706170 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:15:49.706751 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:15:49.707055 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:15:49.707293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:15:49.707843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:15:49.708229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.708560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.709005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.709358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.709689 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.710008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.710380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.710699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.711663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.711932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.712254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.712588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-2-iscsi {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.712915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.713225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.713605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.713896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:15:49.714313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.714410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:15:49.714491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.714570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.714775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:15:49.714882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.715100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:15:49.715368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:15:49.715481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.716719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.716719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.716923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.716923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717304 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.717593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.719176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.719449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.719673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.719927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.720169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.720417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.720635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.720881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.721134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.721348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.721348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-2-iscsi {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.721787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-2-iscsi {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.722896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.723293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.723524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.723784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.723976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.724155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.724350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.724506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.724506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.724838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.725989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.726173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.726332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.726488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.726643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.726790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.727017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.727174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.727318 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.727477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.728506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.728674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.728829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.728983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-2-iscsi {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.729907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730181 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.730965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.731110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.731267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.731418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.731418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.733870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.733870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.734995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.735881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.736889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.737033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.737187 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.737549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.737734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.740858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.740858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741521 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741521 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.741845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.742971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743430 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743751 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.743897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.744569 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.744726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.744888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745188 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.745951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.747294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.747482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.747644 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.747803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.747967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.748153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.748342 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.748536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.748695 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.748859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.749944 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.750895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.751969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.752250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.752406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.752557 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.752716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.752861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.753921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.754901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.755848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756190 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.756986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.757269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.757429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.757574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.757719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.758539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.758700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.758871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.759891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.760850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.761009 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.761213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.761370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.762768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.762969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.763905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764207 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764508 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.764968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.765113 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.765272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766020 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.766962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.767869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.768940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.769095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.769248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.769401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.769401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.769780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.769926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.770100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.770253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.770453 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.770604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.771067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.771230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.771384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.771529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.771724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.771883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.772036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.772196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.772340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.772491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.772646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.772791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.772946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.773092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.773235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.773387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.774243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.774401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.774559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.774716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:15:49.774867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.775027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.775180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.775332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.775486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.776219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.776383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.776543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.776872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.777956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.778133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.778295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.778441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.778600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.778865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779027 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.779784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.780808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.781173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.781389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.781541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.781687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.781855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.782951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.783095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.783240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.783426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.783587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.783732 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.785664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.786406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.786574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.786726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.786899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787094 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.787999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.788144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.788299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.788454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.788608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.788866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789020 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789361 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.789971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.790974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.791252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.791252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.791542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.791815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.791967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792563 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.792870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.793905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.794995 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.795886 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.796457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.796608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.796751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.796887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797159 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.797872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798591 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.798950 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.799909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800594 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.800955 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.801086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.801338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.801484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.801631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.801762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.802288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.802421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.802611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.802741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.802891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803161 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803409 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.803997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.804263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.804426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.804600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.804755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.804886 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.808442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.808635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.808788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.808933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809860 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.809999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.810951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.811209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.811356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.811619 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.811764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.811903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.812904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813840 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.813982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814851 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.814990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.815924 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.816627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817362 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.817910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818578 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.818986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.819346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.819486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.819486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.821980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.822133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.822133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.822497 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.822652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.822872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823774 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.823906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824160 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.824974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825327 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.825932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.826919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.828572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.828727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.828867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829767 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.829905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.830982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831121 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.831892 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832277 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.832803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.833989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.834894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.835854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.836531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.836531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.836804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.836945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.836945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837477 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.837938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.838067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.838229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.838229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.838803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.838938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.839811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840471 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.840876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.841967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.842172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.842319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.842467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.842761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.842896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843812 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.843949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.844875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.845015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.845015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.845268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.845413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.845413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.846896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847571 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.847716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.848000 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.848132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.848262 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.849952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.849952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.849952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.850418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.850557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.850557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.851377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.851518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.851518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.851518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.852033 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.852172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.852309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.852440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.852440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.853898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.854851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.855936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.856889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.857951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.858794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.859409 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.859547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.859547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.860448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.860589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.860589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.860895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.861980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862133 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.862812 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.863105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.863105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.863370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.863523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.863767 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.864827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.865154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.865690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.865690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.865962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866423 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.866827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867087 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.867918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.868960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869676 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.869824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.871802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.871936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872078 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872415 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.872954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.873321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.873458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.873591 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.873824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.873824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.874929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.875871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.876996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.877928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878131 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.878894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.879969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.880899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.881031 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.881176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.881330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.881837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.881985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.882131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.882293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.882488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.882632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.883306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.883536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.883673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.883815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.883949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.884876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885007 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.885952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886395 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886656 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.886933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887482 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887735 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.887979 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.888922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.889905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.890977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.892548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.892749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.892869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.892869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893576 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.893937 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894206 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894828 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.894950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.895897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896571 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896753 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.896932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897126 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.897819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.898033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.898221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.898364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.898364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.899876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.900977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901387 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901520 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.901922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.902069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.902245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.902755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.902755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903060 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903060 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.903302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.904941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.905900 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906443 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.906934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907019 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907858 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.907945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.909991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.910788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.911872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.911965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912361 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912521 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.912985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.913098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.913229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.913814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.913897 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.913970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914133 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914482 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914864 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.914944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915264 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915710 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.915929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916394 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916710 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.916951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.917972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918902 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.918995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.919940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920462 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.920876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921405 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.921822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.922875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923194 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923462 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.923805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924352 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.924926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925695 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.925928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.926036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.926266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.926360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.926581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.926676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.927886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.928836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.929808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.930819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.931009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.931328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.931646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.931961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.932150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.932369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.932636 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.932776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.933854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.934912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.935927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.936922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937571 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.937881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.938151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.938269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.938466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.938562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.938785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939710 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.939987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.940987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941316 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941732 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.941956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942304 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.942963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.943929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944342 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.944993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.945203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.945802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.946804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947131 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947453 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.947778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.948971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949077 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.949926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.950119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.950285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.950378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.950661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.950770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.951000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.951323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.951637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.952036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.952138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.952378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.952509 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.952706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.953037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.953358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.953688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.954026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.954371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.954485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.954703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.954838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.955023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.955363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.955772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.956119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.956424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.956586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.956742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.956912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.957861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958204 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958511 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.958851 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959504 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.959989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.960141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.960293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.960457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.960681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.960841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.961558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.961721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.961887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.962929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.963092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.963092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.963527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.963698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.963861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.964872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.965931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.966870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967520 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.967845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.968798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969023 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.969980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970783 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.970962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.971919 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.972982 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973420 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973545 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.973927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974590 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.974921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.975883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.976891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.977887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.978170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.978368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.978510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.978716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.978824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.979049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.979159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.979396 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.979500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.979678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:15:49.979785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.980058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.980380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.980703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.981038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.981362 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.981686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.982007 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.982356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.982678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.983000 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.983320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.983640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.983960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.984279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.984599 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.984918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.985244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.985747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.987110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.987709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.988075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.988428 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.988770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.989114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.989445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.989867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.990239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.990596 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.991460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.991460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.991701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.992032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.992398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.992737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.993067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.993407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.993886 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.994074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.994432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.994760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.995107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.995470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.995812 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.996152 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.996473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.996796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.997112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.997437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.997776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.998120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.998440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.998946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.999063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.999381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:49.999700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.000016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.000333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.000653 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.000967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.001286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.001601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.001914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.002255 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.002574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.002894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.003209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.003527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.003641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.003975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.004142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.004456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.004804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.005150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.005479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.005816 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.006612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.006752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.008655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.009122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.009487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.010057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.010294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.010971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.010971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.011230 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.011498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.011829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.012493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.012838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.013182 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.013505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.013848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.014284 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.014625 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.014958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.015285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.015626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.015953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.016276 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.016604 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.016957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.017340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.017671 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.018005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.018375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.018715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.019056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.019395 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.019759 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.020087 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.020446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.020789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.021116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.021444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.021761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:15:50.022022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:15:50.047526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.075886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.context [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af367fc0-4f9a-4803-8740-8f77fd786c48(cell1) {{(pid=117754) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:15:50.080372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:15:50.081954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:15:50.082826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:15:50.084777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:15:50.097477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.097918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.113395 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.context [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af367fc0-4f9a-4803-8740-8f77fd786c48(cell1) {{(pid=117755) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:15:50.119727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:15:50.120122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:15:50.120949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:15:50.122926 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:15:50.135025 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.136598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.273882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.299346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:15:50.593773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:15:50.601367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:15:50.615734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:15:50.623775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:15:50.950062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:15:50.956272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-60a04639-a9e1-4f56-8f51-e7c959174856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:15:50.962136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5565858039c0 pid: 117754 (default app) May 10 20:15:50.971633 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:15:50.978513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-9400c25f-b9c2-4a71-a399-45eef9829f80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:15:50.983801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5565858039c0 pid: 117755 (default app) May 10 20:16:35.263795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-73184cc7-197c-4de1-87ff-ff5cec6a50d6 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602b0cdf70>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:36.127739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-73184cc7-197c-4de1-87ff-ff5cec6a50d6 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ed83a47c-8b16-4b06-bcbb-e14f64fbcf47" status: 200 len: 350 microversion: 2.1 time: 1.085181 May 10 20:16:36.130725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1/1] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:16:35 2022] GET /compute/v2.1/os-volumes/ed83a47c-8b16-4b06-bcbb-e14f64fbcf47 => generated 350 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:38.008200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1499484964", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "networks": [{"uuid": "96c29c32-3228-4be3-bd31-e1b4551cb0b8"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:16:38.137744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e60b982-c48b-43ee-9bc2-ff3314bd6651 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af66280>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:38.207624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7e60b982-c48b-43ee-9bc2-ff3314bd6651 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6bf22ef4-9eca-436b-ba9e-42c5d8527e65" status: 200 len: 351 microversion: 2.1 time: 0.074027 May 10 20:16:38.214020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 2/2] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:16:38 2022] GET /compute/v2.1/os-volumes/6bf22ef4-9eca-436b-ba9e-42c5d8527e65 => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:38.530523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] validate_networks() for [('96c29c32-3228-4be3-bd31-e1b4551cb0b8', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:16:40.588526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-09278f30-8718-4166-a99e-dade1085cba7 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af669d0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:40.593205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:16:40.594245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:16:40.594879 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:16:40.595472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:16:40.595879 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:16:40.613049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:40.619385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:40.619385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:40.619385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:40.726861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-09278f30-8718-4166-a99e-dade1085cba7 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b0a5d7eb-0b43-47c9-8ef8-da3f0778c221" status: 200 len: 350 microversion: 2.1 time: 0.142564 May 10 20:16:40.727431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 3/3] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:16:40 2022] GET /compute/v2.1/os-volumes/b0a5d7eb-0b43-47c9-8ef8-da3f0778c221 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:16:40.738728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca1c17da-7b97-4f18-ad74-65dd729cd2e8 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af66b80>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:40.757812 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Getting quotas for project 19fcef97d9fc42889ca1435f33cef96b. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:16:40.766378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Getting quotas for user c9bc1ceb41a6485094ece96346398ef0 and project 19fcef97d9fc42889ca1435f33cef96b. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:16:40.786988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:16:40.791535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:16:40.933920 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca1c17da-7b97-4f18-ad74-65dd729cd2e8 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.199015 May 10 20:16:40.935487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 4/4] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 10 20:16:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:40.961904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-104f53f8-1d7d-4dc2-857d-d6cdbe33d802 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af66e50>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:41.064664 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-096d417d-6bac-4796-bbac-295a95117dfc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.559947 May 10 20:16:41.069632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 1/5] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:16:41.076357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-84e291f1-5887-4b0c-899f-e54dbe916c05 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:41.078759 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-84e291f1-5887-4b0c-899f-e54dbe916c05 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:41.141797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-104f53f8-1d7d-4dc2-857d-d6cdbe33d802 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.191225 May 10 20:16:41.144061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 5/6] 10.222.0.65 () {58 vars in 1148 bytes} [Tue May 10 20:16:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:41.156061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30b7443e-2e7f-4261-baa3-01750ed34c28 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af66dc0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:41.403541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30b7443e-2e7f-4261-baa3-01750ed34c28 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.250715 May 10 20:16:41.404388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 6/7] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 10 20:16:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:41.415578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e958344a-4fcb-40b0-8681-7d4f5256eec7 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602af66ca0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:41.537735 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-84e291f1-5887-4b0c-899f-e54dbe916c05 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:41.564154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-84e291f1-5887-4b0c-899f-e54dbe916c05 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1215 microversion: 2.1 time: 0.491749 May 10 20:16:41.564859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 2/8] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:41 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1215 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:16:41.637404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e958344a-4fcb-40b0-8681-7d4f5256eec7 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.225648 May 10 20:16:41.645532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 7/9] 10.222.0.65 () {58 vars in 1166 bytes} [Tue May 10 20:16:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:41.652224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6e242580-124a-4611-8ae1-92b9289b33fa tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f6029e3ed30>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:41.917326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6e242580-124a-4611-8ae1-92b9289b33fa tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.269912 May 10 20:16:41.918333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 3/10] 10.222.0.65 () {58 vars in 1169 bytes} [Tue May 10 20:16:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:41.933924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-381fa6b3-3431-40f4-8a97-a2efbf34a260 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602aef8b80>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:42.101956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-381fa6b3-3431-40f4-8a97-a2efbf34a260 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.169167 May 10 20:16:42.104696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 8/11] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 10 20:16:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:42.113116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0ab30ae0-99ed-41ce-aeaf-4ea67fd0c893 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f6029e31b80>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:42.350947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0ab30ae0-99ed-41ce-aeaf-4ea67fd0c893 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.244899 May 10 20:16:42.361058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 4/12] 10.222.0.65 () {58 vars in 1187 bytes} [Tue May 10 20:16:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:42.372038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4a8fdde-102d-4229-a255-8eacfb20a1c8 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] Calling method '.version_select at 0x7f602aef8e50>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:42.559543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e4a8fdde-102d-4229-a255-8eacfb20a1c8 tempest-VolumesTestJSON-1282703150 tempest-VolumesTestJSON-1282703150-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.196196 May 10 20:16:42.560198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 9/13] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 10 20:16:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:42.582924 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d10bf939-87e4-4deb-9595-0231477b9e06 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:42.583547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d10bf939-87e4-4deb-9595-0231477b9e06 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:42.768696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d10bf939-87e4-4deb-9595-0231477b9e06 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:42.776953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d10bf939-87e4-4deb-9595-0231477b9e06 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1215 microversion: 2.1 time: 0.198872 May 10 20:16:42.779965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 5/14] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:42 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:43.799283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-06693e78-52e4-4a76-b8ed-96c00dc09b6d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:43.801774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-06693e78-52e4-4a76-b8ed-96c00dc09b6d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:44.088095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-06693e78-52e4-4a76-b8ed-96c00dc09b6d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:44.128211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-06693e78-52e4-4a76-b8ed-96c00dc09b6d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1215 microversion: 2.1 time: 0.335270 May 10 20:16:44.131018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 10/15] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:43 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:45.147706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:45.148455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:45.178963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:45.184504 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:45.186203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:45.188959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:45.817534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:45.843176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-25fdea43-e1b3-4edc-bba2-f999ae41cc12 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1211 microversion: 2.1 time: 0.696131 May 10 20:16:45.853145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 6/16] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:45 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1211 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:46.860918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:46.861682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:46.875551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:46.875996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:46.880829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:46.881280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:46.921380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-609056101", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:16:47.067569 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:47.091751 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9c077d2b-d263-41de-a67c-c2df7e554056 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1273 microversion: 2.1 time: 0.234795 May 10 20:16:47.096584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 7/17] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:46 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:16:47.133429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] validate_networks() for [('3b1220fb-9a6d-4fc5-8525-c6ec85061eb5', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:16:48.114357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:48.115261 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:48.127546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:48.132418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:48.133672 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:48.135827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:48.261053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:48.271306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-90f906ff-7ad4-481d-b311-9ad0839aa671 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1273 microversion: 2.1 time: 0.161000 May 10 20:16:48.274019 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 8/18] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:48 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:49.295214 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:49.298933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:49.329378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:49.332540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:49.338996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:49.338996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:49.530334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:49.543760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8b2262cf-8cd7-4ae9-a865-6d04d556c1d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1273 microversion: 2.1 time: 0.256792 May 10 20:16:49.544353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 9/19] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:49 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:50.415061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:16:50.415539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:16:50.416175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:16:50.416175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:16:50.416547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:16:50.453878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:50.454363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:50.456550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:50.460383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:50.540796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:16:50.551246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for user 261d01f5b22340a09708c71be64edae8 and project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:16:50.570143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:16:50.570960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:50.570960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:50.571568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:16:50.603795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:50.608570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:50.608570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:50.608570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:50.937540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:50.949777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a6d47fce-07b1-4c8c-a134-44ca06484c65 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1273 microversion: 2.1 time: 0.391556 May 10 20:16:50.953822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 10/20] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:50 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1273 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:16:50.971023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cba8ab97-14fe-44de-ba38-a589b97ad977 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.390480 May 10 20:16:50.976455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 11/21] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:16:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:16:50.988085 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5bade18c-901f-44a0-9b6a-ad3d85ff1194 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:50.991070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5bade18c-901f-44a0-9b6a-ad3d85ff1194 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:51.286266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5bade18c-901f-44a0-9b6a-ad3d85ff1194 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:51.305238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5bade18c-901f-44a0-9b6a-ad3d85ff1194 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1221 microversion: 2.1 time: 0.323054 May 10 20:16:51.309011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 11/22] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:50 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:51.660330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1378926487", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:16:51.854250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] validate_networks() for [('3b1220fb-9a6d-4fc5-8525-c6ec85061eb5', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:16:51.968146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:51.968772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:51.980452 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:51.984930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:51.984930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:51.984930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:52.734580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:52.752342 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3924a289-a61a-440d-9fe3-fae11fbe3653 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1273 microversion: 2.1 time: 0.788165 May 10 20:16:52.785696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:51 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1273 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:16:53.793587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:53.796236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:53.825442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:53.827676 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:53.832700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:53.833770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:54.260179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:54.270361 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-df330624-e471-4a0a-9c36-0220de567fa9 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.483350 May 10 20:16:54.271895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 13/24] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:53 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:54.673657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:16:54.676010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:16:54.676823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:16:54.677459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:16:54.678319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:16:54.694757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:54.696967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:54.698059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:54.700532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:54.756647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:16:54.762129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for user 261d01f5b22340a09708c71be64edae8 and project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:16:54.776244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:16:54.784441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:16:54.953438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-07ab9319-b756-4588-be84-02b4f0845eee tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.285801 May 10 20:16:54.955620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 12/25] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:16:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:16:54.966323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-029e727e-6901-427e-86f5-cc5e62f267ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:54.967049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-029e727e-6901-427e-86f5-cc5e62f267ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:55.182041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-029e727e-6901-427e-86f5-cc5e62f267ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:55.198005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-029e727e-6901-427e-86f5-cc5e62f267ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1222 microversion: 2.1 time: 0.236047 May 10 20:16:55.204542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:54 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:55.287794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:55.288865 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:55.302558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:55.320836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:55.323066 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:55.327488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:55.817604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-57815ca4-11a0-40e2-931f-afe4e0b2fc86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: .version_select at 0x7f6029dbb8b0>, body: {"keypair": {"name": "tempest-keypair-1167115024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSgGF4UC9U9HZsRkHmRJB1Pi7W0Sf1i1BshX/SufeNK3ezMaeatSijWZzPtY1QY9sH+0GlIP1XQoWD96nAthMFMrxEtCWtqSwsT94tMAvvmU0JjUOPil/e+8hHMFCDkjw=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:16:55.819949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:55.830711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a873ba56-9e6b-42fe-8278-8b777964bacc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.546719 May 10 20:16:55.834547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 15/27] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:55 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:55.891084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-57815ca4-11a0-40e2-931f-afe4e0b2fc86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:16:55.909220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-57815ca4-11a0-40e2-931f-afe4e0b2fc86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for user 35e69662bc7648b8b3e7467cf56c7f5e and project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:16:56.003385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19bf5678-f199-4373-a170-0398a5b71906 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: .version_select at 0x7f6029d048b0>, body: {"keypair": {"name": "tempest-keypair-1326934519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd4cOqLJ0kyZ3sA4+aBxqrRiTzVL4DYRzs0CaA+W6mvKbyTOLH9cO/dEAzQws8Rj3S5pj5rO3Ka7q70wgqmFrLo5s5TBWT4sooP3FcTNTLIzdGgYeNz93VzXviQHEoHIQ=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:16:56.115895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-19bf5678-f199-4373-a170-0398a5b71906 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:16:56.125350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-19bf5678-f199-4373-a170-0398a5b71906 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for user 8feebf7f09cb4f7d81759f8f1336dba5 and project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:16:56.138847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-57815ca4-11a0-40e2-931f-afe4e0b2fc86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.876493 May 10 20:16:56.142165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 13/28] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:16:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:16:56.223398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-67b5a16f-4d4a-4df2-af18-9086890c537d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:56.224072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-67b5a16f-4d4a-4df2-af18-9086890c537d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:56.304331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19bf5678-f199-4373-a170-0398a5b71906 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.470291 May 10 20:16:56.305961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 16/29] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 10 20:16:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 472 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 20:16:56.848772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:56.849558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:56.867227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:56.867227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:56.867227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:56.867227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:57.345762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:57.356544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d5f6513-857f-4241-a48c-ca320230c626 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.511986 May 10 20:16:57.364910 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 17/30] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:56 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:16:57.850439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-67b5a16f-4d4a-4df2-af18-9086890c537d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:57.927518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-67b5a16f-4d4a-4df2-af18-9086890c537d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1222 microversion: 2.1 time: 1.644548 May 10 20:16:57.927518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 14/31] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:56 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1222 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:58.389606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:58.389606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:58.389606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:58.389606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:58.391263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:58.405358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:58.885554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:16:58.894596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:16:58.914630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:58.917331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:58.918606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:16:58.919264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:16:59.562917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:59.594043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab7eee51-66b3-486e-957d-94f49282fed7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1282 microversion: 2.1 time: 0.716638 May 10 20:16:59.597114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 15/32] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:58 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1282 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:16:59.617887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:16:59.621854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c797407b-4996-467d-b7d1-33641da2af53 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 1.245411 May 10 20:16:59.625480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 18/33] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:16:58 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:00.613541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:00.614214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:00.628296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:00.628762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:00.636934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:00.643239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:00.644573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:00.650864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:00.656165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:00.656684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:00.657411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:00.657858 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:01.105820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:01.114153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a737dacc-2c67-4c8e-9113-5621e8555db0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1280 microversion: 2.1 time: 0.505168 May 10 20:17:01.122703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 16/34] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:00 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1280 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:01.233356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-a04d7f4f-b7d4-43dd-be7a-b6ef3420abf8 req-486aa660-024f-444b-b22a-a91ca3a7dc91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7684e951-de3a-48e4-9e3b-394c46f029f7", "tag": "316af1cb-1f2b-4763-9832-bb4b72edb56d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:01.255345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a04d7f4f-b7d4-43dd-be7a-b6ef3420abf8 req-486aa660-024f-444b-b22a-a91ca3a7dc91 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:01.257352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a04d7f4f-b7d4-43dd-be7a-b6ef3420abf8 req-486aa660-024f-444b-b22a-a91ca3a7dc91 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:01.301987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-a04d7f4f-b7d4-43dd-be7a-b6ef3420abf8 req-486aa660-024f-444b-b22a-a91ca3a7dc91 service nova] Creating event network-changed:316af1cb-1f2b-4763-9832-bb4b72edb56d for instance 7684e951-de3a-48e4-9e3b-394c46f029f7 on hv-cinder-82880 May 10 20:17:01.306894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a04d7f4f-b7d4-43dd-be7a-b6ef3420abf8 req-486aa660-024f-444b-b22a-a91ca3a7dc91 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 20:17:01.313168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:01.317244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:01.321406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:01.323087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:01.336598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.compute.rpcapi [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 20:17:01.337761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] Releasing lock "compute-rpcapi-router" {{(pid=117754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 20:17:01.361496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63358990-a570-48b0-8d1f-7c3b760c5ede None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238940 May 10 20:17:01.363171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:01.552869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:01.564385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-01a3193d-f85b-4c81-b1f2-c42bce8bd5fc tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.926059 May 10 20:17:01.564987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 19/36] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:00 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:02.139122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:02.139947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:02.152526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:02.152989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:02.159230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:02.159230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:02.504301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:02.515325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4b196225-4324-4596-8c1e-e974c5edbfe6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.380938 May 10 20:17:02.518577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 18/37] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:02 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:02.583380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:02.584688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:02.591888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:02.592521 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:02.593485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:02.594109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:03.456290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:03.466536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7c70be9d-49ef-40b9-95b5-017376137159 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.888595 May 10 20:17:03.467448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 20/38] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:02 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:03.548413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:03.548413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:03.558331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:03.559210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:03.560290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:03.560896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:03.736744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:03.747628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-00a9e003-8a49-416b-ae1b-eb40247650f2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.215642 May 10 20:17:03.757816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 19/39] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:03 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:04.484334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:04.485047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:04.498898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:04.500906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:04.503963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:04.504339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:04.916975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-bd9ad111-bf52-483d-a105-05068a6facdf req-385e759a-1df5-4294-8dc0-bb42a5ffa09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b", "tag": "c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:04.949939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-bd9ad111-bf52-483d-a105-05068a6facdf req-385e759a-1df5-4294-8dc0-bb42a5ffa09b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:04.952050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-bd9ad111-bf52-483d-a105-05068a6facdf req-385e759a-1df5-4294-8dc0-bb42a5ffa09b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:05.041347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-bd9ad111-bf52-483d-a105-05068a6facdf req-385e759a-1df5-4294-8dc0-bb42a5ffa09b service nova] Creating event network-changed:c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972 for instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b on hv-cinder-82880 May 10 20:17:05.041917 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-bd9ad111-bf52-483d-a105-05068a6facdf req-385e759a-1df5-4294-8dc0-bb42a5ffa09b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 20:17:05.043105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:05.043554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:05.044355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:05.055280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:05.063791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:05.077985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.compute.rpcapi [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 20:17:05.080077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-94264fef-c4fb-4f44-ba37-09a0c8d49997 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.597321 May 10 20:17:05.082419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 20/40] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:04 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:05.091300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] Releasing lock "compute-rpcapi-router" {{(pid=117755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 20:17:05.099710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-343992252", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b00b815-407a-4d47-9742-67b948c39d25"}], "security_groups": [{"name": "tempest-securitygroup--1936110575"}], "key_name": "tempest-keypair-1167115024", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:05.157568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-40cb2c96-4fd6-40cc-a946-4e9bd7d5174e None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702616 May 10 20:17:05.158210 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 21/41] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:05.169728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:05.170843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:05.207802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:05.208265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:05.215748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:05.216821 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:05.495909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] validate_networks() for [('2b00b815-407a-4d47-9742-67b948c39d25', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:17:05.761116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:05.774421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d4b5794-a197-4533-9952-dcea45d04093 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.612357 May 10 20:17:05.776333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:05 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:05.790328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-888229901", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e95ad3ef-7b5f-4775-9b13-3ca347d35ec6"}], "security_groups": [{"name": "tempest-securitygroup--1047028668"}], "key_name": "tempest-keypair-1326934519", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:06.049745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] validate_networks() for [('e95ad3ef-7b5f-4775-9b13-3ca347d35ec6', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:17:06.682267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:17:06.682267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:17:06.682267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:17:06.682267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:17:06.682267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:17:06.690118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:06.690118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:06.690118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:06.690118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:06.711589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:17:06.714479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for user 8feebf7f09cb4f7d81759f8f1336dba5 and project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:17:06.727582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:17:06.730202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:17:06.912761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f06ae8c1-a81f-40e2-8f9c-d6213e693334 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.133420 May 10 20:17:06.919869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 23/43] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 10 20:17:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 20:17:06.926846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:06.928450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:06.935991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:06.936643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:06.937568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:06.938192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.235858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:17:07.236883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:17:07.241846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:17:07.242788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:17:07.244625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:17:07.257610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:07.258837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.259560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:07.260524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.262435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.276416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-17e79a9c-938e-4ad2-8de8-f67b7b5d268e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.355110 May 10 20:17:07.278696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 24/44] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:06 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:07.284342 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:07.287469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:17:07.287721 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:07.289833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for user 35e69662bc7648b8b3e7467cf56c7f5e and project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:17:07.294238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:07.295089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.296258 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:07.296896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.307361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:17:07.310311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:17:07.487688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.496647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-319e1040-1ab3-48e5-9a35-3fa43610f1ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.215284 May 10 20:17:07.497776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 25/45] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:07 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:07.502782 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:07.503492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:07.525450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-11a7f6e1-280f-4570-a0d3-3736fbcb57da tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.441717 May 10 20:17:07.533295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 21/46] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:17:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:17:07.541349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-0e9584f9-1329-42ce-abf0-451c64e5736c req-77d780a8-6fd6-4787-9d81-17793367e4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6760c43d-64a5-4cbf-b559-07d871e81f18", "tag": "d09063b0-3b3a-44ec-8588-f6884472f3ad"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:07.566043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0e9584f9-1329-42ce-abf0-451c64e5736c req-77d780a8-6fd6-4787-9d81-17793367e4db service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:07.566043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0e9584f9-1329-42ce-abf0-451c64e5736c req-77d780a8-6fd6-4787-9d81-17793367e4db service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:07.600295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-0e9584f9-1329-42ce-abf0-451c64e5736c req-77d780a8-6fd6-4787-9d81-17793367e4db service nova] Creating event network-changed:d09063b0-3b3a-44ec-8588-f6884472f3ad for instance 6760c43d-64a5-4cbf-b559-07d871e81f18 on hv-cinder-82880 May 10 20:17:07.622537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-0e9584f9-1329-42ce-abf0-451c64e5736c req-77d780a8-6fd6-4787-9d81-17793367e4db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087545 May 10 20:17:07.625488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 22/47] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:07.636634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.640864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-15b2e5c4-8886-4399-beaf-765c3c76eb27 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:07.651684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.652848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-15b2e5c4-8886-4399-beaf-765c3c76eb27 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:07.657381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.676437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1293cf52-44d4-4481-b479-d03eb2a24736 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1281 microversion: 2.20 time: 0.161444 May 10 20:17:07.677297 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 26/48] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:07 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:07.735089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15b2e5c4-8886-4399-beaf-765c3c76eb27 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:07.745154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-15b2e5c4-8886-4399-beaf-765c3c76eb27 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1237 microversion: 2.1 time: 0.115729 May 10 20:17:07.747062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 23/49] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:07 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:08.295311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:08.295928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:08.304307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.304307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.304307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.305154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.461788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.469305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19731dd4-1a4d-4ad2-a049-3a07ed5819ec tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.177753 May 10 20:17:08.469863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 27/50] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:08 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:08.516751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:08.517412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:08.533006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.534886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.536272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.536728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.695332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:08.695964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:08.705337 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.705791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.706602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:08.707043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:08.753559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.761375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa5ed3e2-48b9-4be7-8666-347f4174c079 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.249590 May 10 20:17:08.761952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 24/51] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:08 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:08.768960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.772852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b4a43431-696d-49d3-8b94-38c0c9287852 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:08.773478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b4a43431-696d-49d3-8b94-38c0c9287852 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:08.778881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.780470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.781610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9c377ef6-90d1-43ed-9774-50d282fce907 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1285 microversion: 2.20 time: 0.090948 May 10 20:17:08.782218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 28/52] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:08 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:08.825014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b4a43431-696d-49d3-8b94-38c0c9287852 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:08.831709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b4a43431-696d-49d3-8b94-38c0c9287852 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1237 microversion: 2.1 time: 0.068679 May 10 20:17:08.832201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 25/53] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:08 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:09.492586 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:09.493187 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:09.499265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.499707 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.500463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.500890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.644808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.652684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2437a241-3aeb-4869-9afc-692c7597d0fa tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.163994 May 10 20:17:09.653425 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 29/54] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:09 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:09.778566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:09.779187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:09.784856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.785348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.786720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.787229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.800593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:09.801675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:09.807519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.807965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.808725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.809150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.873758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.882597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.884119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.885232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b80e68fc-82b3-443b-b8ca-d2924ad49ebb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1277 microversion: 2.20 time: 0.089006 May 10 20:17:09.885795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 30/55] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:09 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:09.890164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:09.890958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:09.897273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.897724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.898539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:09.898979 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:09.925229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.932648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9577fb5c-6b70-4ef1-a5f7-76861c712dbc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.157943 May 10 20:17:09.933229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 26/56] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:09 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:09.959272 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:09.965845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-73acffa4-e79f-464f-839d-b88eb419a2ca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1241 microversion: 2.1 time: 0.079079 May 10 20:17:09.966455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 31/57] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:09 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:10.684166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:10.684166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:10.685733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.686231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.687011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.687445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.828304 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:10.836366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1130210b-62c7-4451-a10d-b35b1ecba9ab tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.161506 May 10 20:17:10.837061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 27/58] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:10 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:10.903919 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:10.904665 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:10.910689 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.911143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.911914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.912348 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.949387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:10.950035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:10.956173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.956661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.957713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:10.959012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:10.978499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:10.987268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:10.988989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:10.990106 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3748afa5-9d19-4281-b534-7a81b72f13fe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1277 microversion: 2.20 time: 0.090099 May 10 20:17:10.999658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 32/59] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:10 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:10.999658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:10.999658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:11.001802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:11.002289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:11.003067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:11.003512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:11.077774 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:11.086766 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ea225a97-143e-4e34-845f-a490243fd644 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1241 microversion: 2.1 time: 0.094654 May 10 20:17:11.088627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 33/60] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:10 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:11.555263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:11.562869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-124b7aec-409c-49c4-b8bb-c8161833cd6d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.617470 May 10 20:17:11.563685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 28/61] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:10 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:11.852703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:11.853314 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:11.859594 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:11.860958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:11.860958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:11.861213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.005969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.008438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:12.009445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:12.014346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-280764c9-2841-4419-93f5-ad43ea79fbbe tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.164926 May 10 20:17:12.015292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 34/62] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:11 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:12.017248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.018223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.018507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.018950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.091796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.100028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.101933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.103278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e30fb5d-ed5d-47ec-b045-6a1edd9f2dbb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1333 microversion: 2.20 time: 0.099641 May 10 20:17:12.109391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 29/63] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:12 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:12.109588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:12.109588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:12.112833 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.113279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.115041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.115640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.184229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.191760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f7d71b46-1435-4289-831b-aa90c1d09d36 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1233 microversion: 2.1 time: 0.090473 May 10 20:17:12.192853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 35/64] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:12 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:12.580502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:12.581153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:12.587540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.588001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.588766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:12.589221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:12.724450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:12.731603 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7e17cd2f-f681-4df2-883f-b8647cdec3ca tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.154952 May 10 20:17:12.732169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 30/65] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:12 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:13.035708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:13.036254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:13.042247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.042818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.043613 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.044048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.121436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:13.122054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:13.128190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.128705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.129540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.129982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.173975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.182475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-625a635f-958e-4622-b136-39eb7891026e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.150551 May 10 20:17:13.183050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 36/66] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:13 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:13.204459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.211583 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:13.212210 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:13.220190 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.220849 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.221632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.222070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.222799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.225031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.226779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bed585a1-f708-463c-97aa-50c890de7459 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1333 microversion: 2.20 time: 0.109350 May 10 20:17:13.228248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 31/67] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:13 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1333 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:13.282399 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.289841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ec967632-3df0-4d24-8153-1fd31145eefc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1233 microversion: 2.1 time: 0.082487 May 10 20:17:13.290281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 37/68] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:13 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:13.751356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:13.751963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:13.758517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.758968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.760140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:13.760140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:13.908787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:13.916912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6f386917-90b9-4a19-8a4a-e6ec4f7a546b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.169430 May 10 20:17:13.917498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 32/69] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:13 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:14.200730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:14.201913 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:14.208641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.209419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.210438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.211129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.245146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:14.245750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:14.262472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.263007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.264032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.264579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.405473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:14.415251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1bcb473b-8129-4b09-a7e8-423a840f3a37 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.217714 May 10 20:17:14.416032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 38/70] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:14 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:14.430879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:14.432649 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:14.433406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:14.440148 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.440655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.441559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.442005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.449182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:14.452845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:14.457665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e24ac3ef-10dc-46ad-9d86-2da29a025d0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1333 microversion: 2.20 time: 0.216274 May 10 20:17:14.458506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 33/71] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:14 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1333 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:14.523996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:14.534035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6b01d2b9-980b-4f9a-ab95-2fdcff956b81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1289 microversion: 2.1 time: 0.111478 May 10 20:17:14.534638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 39/72] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:14 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:14.941877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:14.943148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:14.958662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.960365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:14.963826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:14.964729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.347374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.359865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b466bcf8-8f19-4cc7-92a0-e114b837b8de tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.427980 May 10 20:17:15.361020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 34/73] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:14 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:15.437948 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:15.440862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:15.449762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.450508 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.451417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.452076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.484152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:15.490357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:15.497213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.497660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.498467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.498902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.642216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.660998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.667215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.668988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c398a36-b60d-44f5-aa42-e2153974e869 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1339 microversion: 2.20 time: 0.190542 May 10 20:17:15.670510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 35/74] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:15 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:15.678832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:15.680542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:15.689280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.690063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.691224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:15.692492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:15.734115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.746127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-754c2748-0fe9-4b9d-8e5e-4ef4cd399514 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.312527 May 10 20:17:15.746960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 40/75] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:15 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:15.788100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:15.808527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e1f92aa1-ebb0-473e-bd72-d0ed9659c07d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1295 microversion: 2.1 time: 0.129506 May 10 20:17:15.808527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 36/76] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:15 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:16.379092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:16.379713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:16.388268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.388904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.390340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.391603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.628286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:16.641254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4505d243-defb-4bbb-a18c-741063bbf48d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.266713 May 10 20:17:16.644248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 41/77] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:16 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:16.670220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-aa4e0ddc-e2cd-40e1-84b5-83e99f2c1890 req-dbc96f60-236a-4d2c-b811-ceae6189212b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7684e951-de3a-48e4-9e3b-394c46f029f7", "name": "network-vif-plugged", "status": "completed", "tag": "316af1cb-1f2b-4763-9832-bb4b72edb56d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:16.683099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-aa4e0ddc-e2cd-40e1-84b5-83e99f2c1890 req-dbc96f60-236a-4d2c-b811-ceae6189212b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.685828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-aa4e0ddc-e2cd-40e1-84b5-83e99f2c1890 req-dbc96f60-236a-4d2c-b811-ceae6189212b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.691130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:16.691823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:16.700686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-aa4e0ddc-e2cd-40e1-84b5-83e99f2c1890 req-dbc96f60-236a-4d2c-b811-ceae6189212b service nova] Creating event network-vif-plugged:316af1cb-1f2b-4763-9832-bb4b72edb56d for instance 7684e951-de3a-48e4-9e3b-394c46f029f7 on hv-cinder-82880 May 10 20:17:16.702866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.703331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.704130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.707499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-aa4e0ddc-e2cd-40e1-84b5-83e99f2c1890 req-dbc96f60-236a-4d2c-b811-ceae6189212b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201538 May 10 20:17:16.709278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 37/78] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:16.714797 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.769529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:16.778281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:16.813657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.825985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:16.829131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:16.829578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.156698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.172562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.175364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.179587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5c1dc801-1b89-4a6e-a1c0-29cbab2182c3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.492548 May 10 20:17:17.181798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 42/79] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:16 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:17.194023 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:17.195050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:17.210380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:17.214506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.216112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:17.217112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.502936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.517243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-171b8b65-5707-4146-a199-16d841641f9a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.332600 May 10 20:17:17.518699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 43/80] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:17 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:17.604644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.614987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9eaac654-f379-49ec-80c4-1bb736009748 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.855773 May 10 20:17:17.624880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 38/81] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:16 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:17.662412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:17.663608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:17.669784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:17.670303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.671240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:17.671854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.825811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-914eb678-b83d-4c4b-ad21-fd82f351cc5a req-c3548fd7-9f45-4920-8501-1b8a17c6d3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f6cc79-11c0-4244-ac21-ac182db7d7cc", "tag": "f3ad9929-2cb4-4711-9a32-8294a05717b6"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:17.839438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-914eb678-b83d-4c4b-ad21-fd82f351cc5a req-c3548fd7-9f45-4920-8501-1b8a17c6d3d9 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:17.840349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-914eb678-b83d-4c4b-ad21-fd82f351cc5a req-c3548fd7-9f45-4920-8501-1b8a17c6d3d9 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:17.853553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-914eb678-b83d-4c4b-ad21-fd82f351cc5a req-c3548fd7-9f45-4920-8501-1b8a17c6d3d9 service nova] Creating event network-changed:f3ad9929-2cb4-4711-9a32-8294a05717b6 for instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc on hv-cinder-82880 May 10 20:17:17.859437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-914eb678-b83d-4c4b-ad21-fd82f351cc5a req-c3548fd7-9f45-4920-8501-1b8a17c6d3d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037875 May 10 20:17:17.860334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 39/82] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:17.895063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:17.899438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0f22cff6-29c3-45ac-a285-1fdf5b15f997 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.240763 May 10 20:17:17.909044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 44/83] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:17 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:18.205035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:18.206057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:18.217874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.218360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.220849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.221505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.535905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:18.536540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:18.545095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.545754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.546874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.558596 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.646619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:18.686976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:18.686976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:18.686976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-568acb6f-b74f-4b14-8461-3d6a527a7004 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.475858 May 10 20:17:18.689027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 40/84] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:18 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:18.697844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-c82ab582-6ffa-43e8-a913-7bac49ea1a3f req-000f07c6-2901-455d-8229-498a0f6d65ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:18.726761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c82ab582-6ffa-43e8-a913-7bac49ea1a3f req-000f07c6-2901-455d-8229-498a0f6d65ad service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.727970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c82ab582-6ffa-43e8-a913-7bac49ea1a3f req-000f07c6-2901-455d-8229-498a0f6d65ad service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.755659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-c82ab582-6ffa-43e8-a913-7bac49ea1a3f req-000f07c6-2901-455d-8229-498a0f6d65ad service nova] Creating event network-changed:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:17:18.765146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-c82ab582-6ffa-43e8-a913-7bac49ea1a3f req-000f07c6-2901-455d-8229-498a0f6d65ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074600 May 10 20:17:18.765993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 41/85] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:18.785229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:18.786194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:18.794048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.794798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:18.795799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:18.796380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.178705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.191058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6c5d94cb-9e31-4e47-8efe-b2b1642011d6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.420327 May 10 20:17:19.191640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 42/86] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:18 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:19.207969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-71691393-5355-49f4-9838-a786d66281f0 req-70e95efb-7de2-4b18-8889-3b44f377396d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b", "name": "network-vif-plugged", "status": "completed", "tag": "c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:19.220375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-71691393-5355-49f4-9838-a786d66281f0 req-70e95efb-7de2-4b18-8889-3b44f377396d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:19.228533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-71691393-5355-49f4-9838-a786d66281f0 req-70e95efb-7de2-4b18-8889-3b44f377396d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.244435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-71691393-5355-49f4-9838-a786d66281f0 req-70e95efb-7de2-4b18-8889-3b44f377396d service nova] Creating event network-vif-plugged:c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972 for instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b on hv-cinder-82880 May 10 20:17:19.269391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-71691393-5355-49f4-9838-a786d66281f0 req-70e95efb-7de2-4b18-8889-3b44f377396d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066550 May 10 20:17:19.270118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 43/87] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:19.276177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.293568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:19.294946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:19.309180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e504a5a-2951-4386-a017-abc4f59526e7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.775398 May 10 20:17:19.310221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 45/88] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:18 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:19.316620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:19.317088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.321842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:19.322587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.555002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.563957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0863e141-5494-42bf-a547-e6e8344e6c7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.289405 May 10 20:17:19.564650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 44/89] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:19 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:19.697620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:19.705213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:19.726141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:19.726849 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.729350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:19.731089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:19.874703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.882506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.884017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:19.885176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9fd452e8-43fa-4f89-b3fb-14a560de52a0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.193048 May 10 20:17:19.885754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 46/90] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:19 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:20.208976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:20.210249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:20.219262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.222376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.224507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.225181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.329343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:20.330390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:20.341035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.341035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.341035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.341035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.574933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:20.585137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e239634c-39df-421d-b22f-ac1f883ef586 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1315 microversion: 2.1 time: 0.380346 May 10 20:17:20.585950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 45/91] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:20 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:20.597557 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:20.601827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:20.603066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:20.608442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6648cce7-7b0d-491b-b27a-0e14bf05abcf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.284787 May 10 20:17:20.611223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 47/92] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:20 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:20.614118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.614977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.618503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.618503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.756900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:20.766465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-94061024-84c6-47f9-b875-6a41673034e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.168906 May 10 20:17:20.766465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 46/93] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:20 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:20.904291 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:20.905211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:20.912933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.913393 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:20.914194 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:20.914792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.069947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:21.078453 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:21.079953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:21.081063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-69ca4b92-4050-4a03-98a5-3bfd19276621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.181817 May 10 20:17:21.091477 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 48/94] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:20 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:21.291615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-1e332378-302b-434b-a7f5-fc59d320b29a req-86ae32e2-5e58-4858-ba8a-37179604b478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6760c43d-64a5-4cbf-b559-07d871e81f18", "name": "network-vif-plugged", "status": "completed", "tag": "d09063b0-3b3a-44ec-8588-f6884472f3ad"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:21.301266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1e332378-302b-434b-a7f5-fc59d320b29a req-86ae32e2-5e58-4858-ba8a-37179604b478 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.302344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1e332378-302b-434b-a7f5-fc59d320b29a req-86ae32e2-5e58-4858-ba8a-37179604b478 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.316288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-1e332378-302b-434b-a7f5-fc59d320b29a req-86ae32e2-5e58-4858-ba8a-37179604b478 service nova] Creating event network-vif-plugged:d09063b0-3b3a-44ec-8588-f6884472f3ad for instance 6760c43d-64a5-4cbf-b559-07d871e81f18 on hv-cinder-82880 May 10 20:17:21.322816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-1e332378-302b-434b-a7f5-fc59d320b29a req-86ae32e2-5e58-4858-ba8a-37179604b478 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 May 10 20:17:21.323782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 47/95] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:21.602713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:21.603984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:21.609897 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.613056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.613897 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.614407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.628144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:21.629135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:21.637259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.637707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.638515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.639227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.806891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:21.815928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ed1bbbc7-6974-4db5-a9d5-a1bd128cbdb6 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1502 microversion: 2.1 time: 0.216723 May 10 20:17:21.817068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 49/96] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:21 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:21.822133 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:21.822911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:21.828623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.829071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.829847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:21.830292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:21.886504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:21.896707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8eda06c8-1977-4ce4-97ee-98b6fb717dd0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.271658 May 10 20:17:21.898756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 48/97] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:21 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:22.001452 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:22.011848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0db8da0d-a4c5-40d1-b749-d11c72a27dbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.193504 May 10 20:17:22.012797 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 50/98] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:21 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:22.107164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:22.107921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:22.117886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:22.118395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:22.124995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:22.124995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:22.346127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:22.367488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:22.370629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:22.373233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3dde6b48-28a5-4941-9094-a86627ad1eb0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.270869 May 10 20:17:22.373815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 49/99] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:22 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:22.918361 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:22.918971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:22.925034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:22.925473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:22.926325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:22.926978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:23.035460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:23.036360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:23.045361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:23.046035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:23.047316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:23.047960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:23.094912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:23.099857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ef3aeccf-ead9-492d-8cb3-c0615ebd48c6 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.185091 May 10 20:17:23.100519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 51/100] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:22 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:23.201370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:23.209467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82e65a13-f6c0-4bb2-851d-2400ad7a6acf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.180562 May 10 20:17:23.210100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 50/101] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:23 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:23.391522 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:23.392124 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:23.398491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:23.407234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:23.407234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:23.407234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:23.569876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:23.585024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:23.585024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:23.585191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b444ba97-8ab4-4407-bd87-9ebf0acf6a6c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.197541 May 10 20:17:23.586221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 52/102] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:23 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:24.116984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:24.117590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:24.124234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.124690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.125496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.125931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.225699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:24.226994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:24.234063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.234826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.235789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.236413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.264107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:24.314963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5d8825fd-693c-42e2-8ecb-7367968e1272 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.189701 May 10 20:17:24.317629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 51/103] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:24 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:24.399177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:24.432833 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7ca4701c-e974-4a2d-84a0-c322e3d86e62 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1322 microversion: 2.1 time: 0.190597 May 10 20:17:24.433822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 53/104] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:24 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:24.460861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-7648a699-fc7b-49cb-b15d-a8303dfdd78f req-d48d0614-2e94-43aa-9775-73688ddc6668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f6cc79-11c0-4244-ac21-ac182db7d7cc", "name": "network-vif-plugged", "status": "completed", "tag": "f3ad9929-2cb4-4711-9a32-8294a05717b6"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:24.472936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7648a699-fc7b-49cb-b15d-a8303dfdd78f req-d48d0614-2e94-43aa-9775-73688ddc6668 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.473396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7648a699-fc7b-49cb-b15d-a8303dfdd78f req-d48d0614-2e94-43aa-9775-73688ddc6668 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.489995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-7648a699-fc7b-49cb-b15d-a8303dfdd78f req-d48d0614-2e94-43aa-9775-73688ddc6668 service nova] Creating event network-vif-plugged:f3ad9929-2cb4-4711-9a32-8294a05717b6 for instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc on hv-cinder-82880 May 10 20:17:24.495753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-7648a699-fc7b-49cb-b15d-a8303dfdd78f req-d48d0614-2e94-43aa-9775-73688ddc6668 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038363 May 10 20:17:24.497429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 52/105] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:24.524745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6a38508-fe3f-40cb-b51c-5e66351b3b9a"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:24.524745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:24.530758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.531222 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.532670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.533119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.605159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:24.605942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:24.615887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.615887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.615887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:24.615887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:24.772144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:24.782586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:24.784114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:24.786884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c19dac30-f94d-4722-8d2b-b4e8204b879a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.186549 May 10 20:17:24.798111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 53/106] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:24 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:25.332865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:25.333574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:25.339283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.339742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.340498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.340929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.469607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:25.476907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7dac8540-392f-4e13-b7fe-3bf99bea66cf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.147903 May 10 20:17:25.477473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 54/107] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:25 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:25.481911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:25.482536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:25.488484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.488969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.489728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.494774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.639909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:25.645273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d77592ab-ba64-4f2c-b60a-592cd8ac2b27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1515 microversion: 2.1 time: 0.166780 May 10 20:17:25.645875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 55/108] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:25 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:25.668487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:25.669407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:25.675435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.675875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.676635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.677322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.740562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lazy-loading 'flavor' on Instance uuid 6760c43d-64a5-4cbf-b559-07d871e81f18 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:17:25.786401 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bc10aefc-849b-4d61-99e1-198bae026f79 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "POST /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.268959 May 10 20:17:25.797127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 54/109] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:17:24 2022] POST /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7/os-volume_attachments => generated 194 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:25.825663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:25.826389 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:25.833356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.833809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.834622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:25.835135 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:25.973247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:25.982070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:25.984180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:25.985738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5275a1bf-6d4f-4110-9673-1c70ceb52d51 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.164614 May 10 20:17:25.996137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 55/110] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:25 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:26.179214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-de607ee7-b6ce-443a-bcb9-c8e02afa76f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18/action" status: 200 len: 32 microversion: 2.1 time: 0.515187 May 10 20:17:26.179918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 56/111] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:17:25 2022] POST /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 20:17:26.189455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:26.190075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:26.197162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:26.198203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:26.198974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:26.199414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:26.332289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:26.339610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a9c50ec3-fafc-492c-aafa-f4a4fbdf0c71 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.154022 May 10 20:17:26.340180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 56/112] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:26 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:26.495263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:26.496337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:26.502421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:26.502866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:26.503691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:26.504122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:26.638533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:26.646030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-64876d98-1bd3-44b5-9fda-a684cb0ac0c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.155624 May 10 20:17:26.646811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 57/113] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:26 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:26.757638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-6afd725b-c55a-4251-8188-23518e200a55 req-0b18853f-c93e-46aa-991c-2fb99b6c429a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "name": "network-vif-plugged", "status": "completed", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:26.765875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-6afd725b-c55a-4251-8188-23518e200a55 req-0b18853f-c93e-46aa-991c-2fb99b6c429a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:26.766478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-6afd725b-c55a-4251-8188-23518e200a55 req-0b18853f-c93e-46aa-991c-2fb99b6c429a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:26.780572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-6afd725b-c55a-4251-8188-23518e200a55 req-0b18853f-c93e-46aa-991c-2fb99b6c429a service nova] Creating event network-vif-plugged:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:17:26.785549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-6afd725b-c55a-4251-8188-23518e200a55 req-0b18853f-c93e-46aa-991c-2fb99b6c429a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031781 May 10 20:17:26.786383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 57/114] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:27.004519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:27.005081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:27.010927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.011370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.012118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.012556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.139857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:27.147571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:27.149079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:27.150211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-116217dc-b7ac-430a-8f2b-1b5edc835319 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.149686 May 10 20:17:27.151390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 58/115] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:26 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:27.357023 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:27.357755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:27.364283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.364760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.365526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.365966 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.495764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:27.502991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3053e1d5-4c98-409f-be46-62bb229e7bf2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.150254 May 10 20:17:27.503563 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 58/116] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:27 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:27.663029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:27.663594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:27.669457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.669900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.670685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:27.671122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:27.820816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:27.828660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9f3e3e5-05ae-489a-ac6c-875ecd731d81 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.169552 May 10 20:17:27.829225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 59/117] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:27 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:28.168365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:28.168903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:28.175012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.175451 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.176207 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.176636 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.317573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:28.328200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:28.329703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:28.330829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6e0fb672-e548-4e27-8cda-5af34a5b8e31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.166896 May 10 20:17:28.331390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 59/118] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:28 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:28.520055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:28.520663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:28.526926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.527368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.528128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.528557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.660934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:28.668474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-84c09413-54bf-451d-a58c-1fed6182ed99 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.152215 May 10 20:17:28.669047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 60/119] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:28 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:28.845349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:28.845965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:28.852313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.852769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.853562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:28.854003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:28.989498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:29.002367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-54f7f8b0-cab8-4cd0-bf35-221384b69f1f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.155931 May 10 20:17:29.002367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 60/120] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:28 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:29.351504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:29.352183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:29.359024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:29.359546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:29.360306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:29.361079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:29.504651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:29.512945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:29.517437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:29.517437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8604a1e0-64c2-4214-859e-7ddc35d0e084 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.168366 May 10 20:17:29.517437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 61/121] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:29 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:29.686682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:29.687641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:29.695588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:29.696357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:29.697163 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:29.697603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:29.858037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:29.865993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7f39869d-40ed-44c8-8018-49861c47a95d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.183734 May 10 20:17:29.866627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 61/122] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:29 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:30.015094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:30.015624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:30.023511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.024213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:30.025378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.025886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:30.165822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:30.173944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-89fb5581-59ca-4fc1-94ab-55b95efe9cdf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.163357 May 10 20:17:30.174551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 62/123] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:30 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:30.532510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:30.533092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:30.539097 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.539537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:30.540301 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.540730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:30.665107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:30.673064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:30.674679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:30.675786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6172d287-22be-4763-a681-4c711658526d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.147167 May 10 20:17:30.676360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 62/124] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:30 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:30.883152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:30.883766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:30.889567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.890020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:30.890826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:30.891265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:31.013981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:31.021251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3f678dd4-c76a-4561-b584-42b06964b89b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.141953 May 10 20:17:31.021839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 63/125] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:30 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:31.191125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:31.191755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:31.198189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:31.198702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:31.200208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:31.200711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:31.329945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:31.337386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-99f4c3e4-7024-4ae7-9645-dda929818c42 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.150017 May 10 20:17:31.337975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 63/126] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:31 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:31.694660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:31.701574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:31.701865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:31.702247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:31.703005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:31.703434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:31.837512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:31.846216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:31.847783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:31.848924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9afc51f2-3c82-4607-8d8c-64143f703cfa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.158448 May 10 20:17:31.849492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 64/127] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:31 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:32.039137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:32.040371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:32.048322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.049095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:32.049898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.050503 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:32.184451 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:32.193272 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a7bbc4b1-4eb7-4b41-a9a8-ea0f9d884d7b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.159081 May 10 20:17:32.193880 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 64/128] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:32 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:32.355647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:32.356424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:32.365370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.365370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:32.365370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.365370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:32.739121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:32.755130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e990fca-86ae-4aeb-aef9-46e923d707fe tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1363 microversion: 2.1 time: 0.395114 May 10 20:17:32.755130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 65/129] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:32 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:32.872952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:32.873486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:32.882810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.883294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:32.884196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:32.884674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.016212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:33.024821 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:33.026550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:33.027961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b78704eb-a865-48e8-912d-4257819173bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.159595 May 10 20:17:33.028748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 65/130] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:32 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:33.209893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:33.210528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:33.216224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.216673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.217421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.217848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.348891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:33.356192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f85644cc-8ca2-4208-a717-0785370f9f36 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.150299 May 10 20:17:33.357378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 66/131] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:33 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:33.764063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:33.764618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:33.770548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.770994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.771755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.772195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.904436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:33.911580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dee5f0e0-e75d-41e4-aa66-61e385fc24e1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1548 microversion: 2.1 time: 0.151517 May 10 20:17:33.912151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 66/132] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:33 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:33.929055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:33.929539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:33.936509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.936959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:33.937723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:33.938181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:34.016168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5ee44e4f-f05a-4ca0-a67f-f953db3231d1 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091057 May 10 20:17:34.016709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 67/133] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:17:33 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:34.047953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:34.048567 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:34.054780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:34.055216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:34.055989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:34.056419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:34.205406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:34.214461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:34.216130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:34.217447 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bf1290c4-ab28-4370-ba00-e5e108293448 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.173892 May 10 20:17:34.218335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 67/134] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:34 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:34.373297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:34.373819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:34.379681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:34.380129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:34.380889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:34.381321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:34.710645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:34.718091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aea13b99-cd56-461d-88f1-214c8adb1e9c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.349234 May 10 20:17:34.718683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 68/135] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:34 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:35.236083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:35.236726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:35.243438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:35.244040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:35.245106 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:35.245669 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:35.376341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:35.384152 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:35.385680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:35.386836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-901bbdc7-7d1a-456f-9daf-ace720af98f1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.155291 May 10 20:17:35.388508 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 68/136] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:35 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:17:35.574344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-745ce39d-b3f1-4bf9-96e1-d9bd2cf584f0 req-28b7373b-55b9-47fb-8c38-48e2ffeb6e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f6cc79-11c0-4244-ac21-ac182db7d7cc", "tag": "f3ad9929-2cb4-4711-9a32-8294a05717b6"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:35.587779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-745ce39d-b3f1-4bf9-96e1-d9bd2cf584f0 req-28b7373b-55b9-47fb-8c38-48e2ffeb6e2a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:35.588455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-745ce39d-b3f1-4bf9-96e1-d9bd2cf584f0 req-28b7373b-55b9-47fb-8c38-48e2ffeb6e2a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:35.602441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-745ce39d-b3f1-4bf9-96e1-d9bd2cf584f0 req-28b7373b-55b9-47fb-8c38-48e2ffeb6e2a service nova] Creating event network-changed:f3ad9929-2cb4-4711-9a32-8294a05717b6 for instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc on hv-cinder-82880 May 10 20:17:35.608422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-745ce39d-b3f1-4bf9-96e1-d9bd2cf584f0 req-28b7373b-55b9-47fb-8c38-48e2ffeb6e2a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040241 May 10 20:17:35.609201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 69/137] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:35.734570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:35.735214 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:35.741160 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:35.741609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:35.742400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:35.742837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:35.883840 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:35.891832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2c724cc9-6e82-48ca-a2c4-9b2168123de5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.161141 May 10 20:17:35.892414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 69/138] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:35 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:36.406248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:36.406941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:36.413225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:36.413664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:36.414449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:36.414883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:36.552043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:36.561535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:36.563217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:36.564372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db9a7e4e-488b-4411-bbd4-30999398dcad tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1407 microversion: 2.20 time: 0.163251 May 10 20:17:36.565042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 70/139] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:36 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:36.912641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:36.913292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:36.920796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:36.921475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:36.922351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:36.922850 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:37.084660 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:37.092180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e36619c1-5fd8-4377-9a44-e509a40fab47 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.186807 May 10 20:17:37.092785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 70/140] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:36 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:37.584052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:37.584780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:37.590681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:37.591124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:37.592453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:37.592891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:37.813905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:37.822236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:37.823737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:37.824918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85de617e-5956-40f7-90b5-5abeeb4840ac tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1600 microversion: 2.20 time: 0.245622 May 10 20:17:37.825626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 71/141] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:17:37 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1600 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:17:37.845766 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:37.846495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:37.855037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:37.855736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:37.856680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:37.857138 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:37.957789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c430c47d-0971-48e1-a104-385d4a922286 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.116843 May 10 20:17:37.962266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 71/142] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 10 20:17:37 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:17:38.108711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:38.109326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:38.120621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:38.121071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:38.121851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:38.122332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:38.285453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:38.297435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-29f7a3d9-a211-4204-8347-1dcd5184cbaa tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.192449 May 10 20:17:38.298797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 72/143] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:38 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:39.316063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:39.316681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:39.328021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:39.328678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:39.329463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:39.330100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:39.583485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:39.591437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f18e6a2-76e0-410f-ba92-a3dcc0bf3c11 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.280163 May 10 20:17:39.592030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 72/144] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:39 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:39.818782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-3a4c4bc6-2419-402e-abe0-1a74e55a4680 req-5c199348-54f4-421e-a574-4ca078c5210a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:39.827183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3a4c4bc6-2419-402e-abe0-1a74e55a4680 req-5c199348-54f4-421e-a574-4ca078c5210a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:39.828009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3a4c4bc6-2419-402e-abe0-1a74e55a4680 req-5c199348-54f4-421e-a574-4ca078c5210a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:39.853609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-3a4c4bc6-2419-402e-abe0-1a74e55a4680 req-5c199348-54f4-421e-a574-4ca078c5210a service nova] Creating event network-changed:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:17:39.867592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-3a4c4bc6-2419-402e-abe0-1a74e55a4680 req-5c199348-54f4-421e-a574-4ca078c5210a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052694 May 10 20:17:39.869856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 73/145] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:40.609313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:40.611816 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:40.621458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:40.622153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:40.623120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:40.628933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:40.795120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:40.802931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b734a364-fef0-4961-87f7-cd4b6f7a90a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.197652 May 10 20:17:40.804093 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 73/146] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:40 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:41.821974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:41.827634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:41.830592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:41.831352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:41.832147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:41.832672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:42.021917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:42.029552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca0f04ff-b6fb-40b3-839e-a38bf20e0205 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.212335 May 10 20:17:42.030180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 74/147] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:41 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:43.049257 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:43.051037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:43.063470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:43.063980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:43.064965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:43.065502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:43.246363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:43.254917 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3f186e67-7ffa-457b-a58d-5a391f783d67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.211524 May 10 20:17:43.255794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 74/148] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:43 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:44.274204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:44.278746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:44.284514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:44.285465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:44.286599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:44.287033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:44.455854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:44.463475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-02148fa5-5d13-4d00-8a72-3e74d072677b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.195474 May 10 20:17:44.464188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 75/149] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:44 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:45.386850 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:45.387929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:45.394787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.395235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.396002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.396436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.422274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:17:45.481016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:45.481627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:45.487497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.487980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.488872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.489306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.653559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:45.661676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b778921a-a2dd-412e-8645-798514a6f4c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.184494 May 10 20:17:45.662292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 76/150] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:45 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:45.684333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5c099aeb-793c-4370-8830-4295f7a26f81 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 204 len: 0 microversion: 2.1 time: 0.301145 May 10 20:17:45.684929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 75/151] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:17:45 2022] DELETE /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:17:45.693480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:45.694199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:45.700035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.700482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.701250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:45.701686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:45.831237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:45.840071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a6d64736-09b4-4da9-b672-d5318ced3dc5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1554 microversion: 2.1 time: 0.150524 May 10 20:17:45.841195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 77/152] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:45 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:46.681332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:46.682567 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:46.690126 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:46.690574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:46.691431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:46.691817 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:46.828620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:46.836144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3cb36a98-9022-41b3-911b-643586b07fa1 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.160201 May 10 20:17:46.836811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 76/153] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:46 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:46.860635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:46.861405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:46.867297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:46.867918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:46.868845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:46.869269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:46.997374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:47.006369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-603bfa79-0b8d-46cd-9ec9-c1d58c637491 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1554 microversion: 2.1 time: 0.149778 May 10 20:17:47.006951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 78/154] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:46 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:47.853339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:47.853983 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:47.860255 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:47.860714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:47.861520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:47.861971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:47.994185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:48.001877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2196ea49-33fc-44b2-acdb-e26c90f6b005 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.152372 May 10 20:17:48.002488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 77/155] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:47 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:48.023791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:48.024400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:48.030624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:48.033964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:48.033964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:48.033964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:48.300791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:48.308889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c2683e86-086b-45ae-b799-f00236b7289e tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1554 microversion: 2.1 time: 0.288922 May 10 20:17:48.309457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 79/156] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:48 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:49.018475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:49.019085 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:49.025333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:49.025785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:49.026606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:49.027049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:49.154870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:49.162688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-df2ee9d2-036c-41c6-9610-14d8e59410bc tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.148110 May 10 20:17:49.163256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 78/157] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:49 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:49.325978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:49.331711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:49.332490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:49.332931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:49.333716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:49.334174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:49.463255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:49.471764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-89b14ea2-6ed5-434b-beef-862572132a8b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1554 microversion: 2.1 time: 0.149529 May 10 20:17:49.472323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 80/158] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:49 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:50.180465 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:50.181354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:50.188131 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:50.188582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:50.189351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:50.189838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:50.468694 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:50.475736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eb1cf66d-4520-48cd-bc6d-4374690a278e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.299128 May 10 20:17:50.476305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 79/159] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:50 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:50.488849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:50.489448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:50.495576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:50.496020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:50.496797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:50.499625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:50.632836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:50.641467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f0b7e107-300b-4197-b771-190484251fd5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1554 microversion: 2.1 time: 0.156886 May 10 20:17:50.642039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 81/160] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:50 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:51.479299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-84ce0dea-960e-4ca1-b6af-bd0d09703632 req-e2062f5e-e02d-47cc-a882-7255c015648c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7684e951-de3a-48e4-9e3b-394c46f029f7", "name": "network-vif-deleted", "tag": "316af1cb-1f2b-4763-9832-bb4b72edb56d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:17:51.488239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-84ce0dea-960e-4ca1-b6af-bd0d09703632 req-e2062f5e-e02d-47cc-a882-7255c015648c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:51.488685 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-84ce0dea-960e-4ca1-b6af-bd0d09703632 req-e2062f5e-e02d-47cc-a882-7255c015648c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:51.493017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:51.493801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:51.499642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:51.499958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-84ce0dea-960e-4ca1-b6af-bd0d09703632 req-e2062f5e-e02d-47cc-a882-7255c015648c service nova] Creating event network-vif-deleted:316af1cb-1f2b-4763-9832-bb4b72edb56d for instance 7684e951-de3a-48e4-9e3b-394c46f029f7 on hv-cinder-82880 May 10 20:17:51.501261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:51.502045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:51.502557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:51.505582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-84ce0dea-960e-4ca1-b6af-bd0d09703632 req-e2062f5e-e02d-47cc-a882-7255c015648c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 May 10 20:17:51.506204 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 80/161] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:17:51.659941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:51.661068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:51.668641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:51.669409 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:51.670452 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:51.671544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:51.681818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:51.703339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8500ea33-d7f0-4680-b594-f760edd053db tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.214298 May 10 20:17:51.704450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 82/162] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:51 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:51.758921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:51.767422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d4874a74-bbdf-4d45-bc62-cd842fcf16c5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1346 microversion: 2.1 time: 0.112949 May 10 20:17:51.767989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 81/163] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:51 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:17:52.728278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:52.728896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:52.735450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:52.735910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:52.736777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:52.737439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:52.784048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:52.784593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:52.809290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:52.809958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:52.810965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:52.811970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:52.877787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:52.878440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:52.878999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lazy-loading 'fault' on Instance uuid 7684e951-de3a-48e4-9e3b-394c46f029f7 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:17:52.950652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc1ceb41a6485094ece96346398ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fcef97d9fc42889ca1435f33cef96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:52.954146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:52.961796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8a5015a-2ba0-4c57-adab-2f6b5649e39b tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 200 len: 1351 microversion: 2.1 time: 0.182339 May 10 20:17:52.962436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-81b6bf98-fb2e-4325-8aae-f07ece79d691 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.237955 May 10 20:17:52.963026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 83/164] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:52 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:52.972211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 82/165] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:52 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 1351 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:53.980930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:53.982355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:53.986163 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:53.986781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:53.990725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:53.990725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:53.991575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:53.992707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:54.000994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:54.002115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:54.003065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:54.003909 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:54.024698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] HTTP exception thrown: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Request method failure captured: May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 HTTP/1.1 May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesglHtiotqUaUQ6y7RGstNTRfQTz9D-XPDkJrYMnBooNvEnZhuoqwvGS01if907ic3Kr4gKYFHk5jzUzOPe2lN4-b2YIS-SkvImwGQEuQ_Tkuztp42ooKLG3wKA96lSGwlRahC6gY7PkYeH_QxnZGgUzz_g3CCvhSl5sSN714MRK0EQ May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:17:54.030287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_19fcef97d9fc42889ca1435f33cef96b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-DeleteServersTestJSON-937635709-project May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: c9bc1ceb41a6485094ece96346398ef0 May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-DeleteServersTestJSON-937635709-project May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.031585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '7684e951-de3a-48e4-9e3b-394c46f029f7'} May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:17:54.032312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.033450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.034589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Returning 404 to user: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:17:54.034589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6aa68860-5d8b-42b3-baff-e6649fd052ea tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 404 len: 111 microversion: 2.1 time: 0.050149 May 10 20:17:54.034589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 83/166] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:53 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:17:54.151099 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:54.152080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:54.157964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:54.159586 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:54.160279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:54.161386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:54.162193 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:54.166930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b8689a03-7c07-41d8-9fbb-2c8783a1437a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.191530 May 10 20:17:54.167507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 84/167] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:53 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] HTTP exception thrown: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Request method failure captured: May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7/os-volume_attachments HTTP/1.1 May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesglHtiotqUaUQ6y7RGstNTRfQTz9D-XPDkJrYMnBooNvEnZhuoqwvGS01if907ic3Kr4gKYFHk5jzUzOPe2lN4-b2YIS-SkvImwGQEuQ_Tkuztp42ooKLG3wKA96lSGwlRahC6gY7PkYeH_QxnZGgUzz_g3CCvhSl5sSN714MRK0EQ May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:17:54.181179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_19fcef97d9fc42889ca1435f33cef96b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-DeleteServersTestJSON-937635709-project May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: c9bc1ceb41a6485094ece96346398ef0 May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-DeleteServersTestJSON-937635709-project May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.182946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'server_id': '7684e951-de3a-48e4-9e3b-394c46f029f7'} May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:17:54.183645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:17:54.184737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:17:54.185857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Returning 404 to user: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:17:54.185857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f4ad1c8a-df5c-4188-93c0-5ffd6490cb1d tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031808 May 10 20:17:54.185857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 84/168] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:17:54 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:17:55.195827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:55.196474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:55.202733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:55.203186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:55.204546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:55.205161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:55.390509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:55.399516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6fedce28-f398-454a-a847-c045e144ddf0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.208425 May 10 20:17:55.400088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 85/169] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:55 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:56.432918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:56.433535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:56.441034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:56.441584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:56.442466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:56.443049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:56.584533 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:56.592005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5901ae5e-55b5-409a-b1f6-70ed5fa5d141 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.169523 May 10 20:17:56.592673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 85/170] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:56 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:57.608944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:57.609550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:57.616875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:57.617379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:57.618191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:57.619003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:57.762766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:57.771049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfdb16e5-0bbc-4c25-95e5-d8d744809b07 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.165882 May 10 20:17:57.771711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 86/171] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:57 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:17:58.789053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:17:58.789901 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:17:58.796018 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:58.796465 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:58.797246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:17:58.797675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:17:59.034520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:17:59.044955 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ad380106-39fc-4241-9fb9-5ee82391af91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.259763 May 10 20:17:59.047904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 86/172] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:17:58 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:00.062626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:00.065396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:00.073586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:00.075109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:00.076274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:00.076955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:00.311637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:00.320518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8bc0e20f-11fc-453d-95ed-e9f182d71a12 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.261627 May 10 20:18:00.320956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 87/173] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:00 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:01.337777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:01.338430 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:01.345987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:01.346700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:01.348612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:01.349719 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:01.586189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:01.595856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5795c81b-49cd-4427-a794-24ebb1d26455 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1521 microversion: 2.1 time: 0.262095 May 10 20:18:01.600507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 87/174] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:01 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:02.076631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:02.077831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:02.088246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.088246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:02.088246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.088246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:02.121282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] HTTP exception thrown: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Request method failure captured: May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 HTTP/1.1 May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesglHtiotqUaUQ6y7RGstNTRfQTz9D-XPDkJrYMnBooNvEnZhuoqwvGS01if907ic3Kr4gKYFHk5jzUzOPe2lN4-b2YIS-SkvImwGQEuQ_Tkuztp42ooKLG3wKA96lSGwlRahC6gY7PkYeH_QxnZGgUzz_g3CCvhSl5sSN714MRK0EQ May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:18:02.127401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_19fcef97d9fc42889ca1435f33cef96b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-DeleteServersTestJSON-937635709-project May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: c9bc1ceb41a6485094ece96346398ef0 May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-DeleteServersTestJSON-937635709-project May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.129033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '7684e951-de3a-48e4-9e3b-394c46f029f7'} May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:18:02.129894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.135092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:02.136549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Returning 404 to user: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:18:02.136549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6f454ee4-3135-4c63-929c-b4367b4571a0 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 404 len: 111 microversion: 2.1 time: 0.058305 May 10 20:18:02.136549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 88/175] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:18:02 2022] DELETE /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:18:02.147005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:02.152245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] [instance: 7684e951-de3a-48e4-9e3b-394c46f029f7] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:02.159149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.160733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:02.163918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.164553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:02.200963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] HTTP exception thrown: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Request method failure captured: May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 HTTP/1.1 May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesglHtiotqUaUQ6y7RGstNTRfQTz9D-XPDkJrYMnBooNvEnZhuoqwvGS01if907ic3Kr4gKYFHk5jzUzOPe2lN4-b2YIS-SkvImwGQEuQ_Tkuztp42ooKLG3wKA96lSGwlRahC6gY7PkYeH_QxnZGgUzz_g3CCvhSl5sSN714MRK0EQ May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:18:02.202556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/19fcef97d9fc42889ca1435f33cef96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_19fcef97d9fc42889ca1435f33cef96b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 19fcef97d9fc42889ca1435f33cef96b May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-DeleteServersTestJSON-937635709 May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-DeleteServersTestJSON-937635709-project May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: c9bc1ceb41a6485094ece96346398ef0 May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-DeleteServersTestJSON-937635709-project May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.203760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '7684e951-de3a-48e4-9e3b-394c46f029f7'} May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:18:02.204595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. May 10 20:18:02.205806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:18:02.208242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] Returning 404 to user: Instance 7684e951-de3a-48e4-9e3b-394c46f029f7 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:18:02.208242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-31eb4467-4f60-40dd-9df2-0bf7496fc5e5 tempest-DeleteServersTestJSON-937635709 tempest-DeleteServersTestJSON-937635709-project] 10.222.0.65 "GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7" status: 404 len: 111 microversion: 2.1 time: 0.065920 May 10 20:18:02.208242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 88/176] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:02 2022] GET /compute/v2.1/servers/7684e951-de3a-48e4-9e3b-394c46f029f7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:18:02.617620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:02.618606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:02.641525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.642046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:02.643751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:02.651664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:03.077465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:03.091461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a545d3d4-8d70-48f4-a4ad-a972270e6faf tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1501 microversion: 2.1 time: 0.480059 May 10 20:18:03.103711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 89/177] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:02 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1501 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:03.109573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:03.110334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:03.117948 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:03.118686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:03.119777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:03.120306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:03.337734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:03.352484 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a27b2ef4-a637-4fd3-8081-3d9be644f677 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1514 microversion: 2.1 time: 0.246429 May 10 20:18:03.353068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 89/178] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:03 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:05.317155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:05.318223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:05.333141 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:05.333860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:05.334908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:05.335415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:05.365169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lazy-loading 'flavor' on Instance uuid 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:18:05.735685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c80c5cf9-1f61-43e1-b7b2-ce74e915e252 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/action" status: 200 len: 32 microversion: 2.1 time: 0.422400 May 10 20:18:05.736536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 90/179] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:18:05 2022] POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 20:18:05.750512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:05.751330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:05.769322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:05.771153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:05.773073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:05.773815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:06.040281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:06.047987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3d404318-a126-4d43-bee8-764a9bfcede8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.303949 May 10 20:18:06.060577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 90/180] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:05 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:07.076578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:07.077982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:07.088890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:07.089548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:07.100178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:07.106100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:07.454874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:07.466653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e5ed5fb-d365-4422-b03c-1384140af340 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.400969 May 10 20:18:07.467363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 91/181] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:07 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:08.489577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:08.490892 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:08.498253 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:08.499614 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:08.500634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:08.501278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:08.929949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:08.938319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e35cb4cf-bafa-4b81-871e-55bfb08fd7eb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.454057 May 10 20:18:08.941064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 91/182] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:08 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:09.956842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:09.957525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:09.963719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:09.964271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:09.965119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:09.965630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:10.171275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:10.182060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-478a8332-706f-451a-ade9-41f72e779ce3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.228914 May 10 20:18:10.182502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 92/183] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:09 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:11.209265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:11.209884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:11.216208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:11.216538 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:11.217648 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:11.218125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:11.473813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:11.482353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-811f95b0-da60-4fdf-a201-a7805bccacb2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.277378 May 10 20:18:11.483503 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 92/184] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:11 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:12.499827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:12.500435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:12.513072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:12.513986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:12.514983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:12.515563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:12.692593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:12.701425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d0631f7-15b4-4675-85c0-f1b85c1341da tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.205293 May 10 20:18:12.712179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 93/185] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:12 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:13.719559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:13.720228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:13.730280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:13.730731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:13.731507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:13.731933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:13.957661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:13.965556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1fde0022-5bd2-4d4a-87fc-c948911f1998 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.250040 May 10 20:18:13.979717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 93/186] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:13 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:14.983739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:14.985486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:14.996757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:14.997609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:15.002646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:15.002646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:15.236158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:15.255172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d2f3be73-3bd4-47b5-9aa9-9e9b117d2c96 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.275490 May 10 20:18:15.258503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 94/187] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:14 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:16.271618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:16.272226 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:16.279605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:16.280112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:16.280996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:16.281536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:16.444603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:16.453368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-be010270-85a8-448d-bc0b-adf08088557d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.185446 May 10 20:18:16.454171 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 94/188] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:16 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:17.471582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:17.472881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:17.482332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:17.486166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:17.487411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:17.487922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:17.647145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:17.656636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad97fdec-f3bf-426f-bbbc-32b111173b1c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.190153 May 10 20:18:17.657835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 95/189] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:17 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:18.674051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:18.674693 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:18.681754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:18.682499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:18.683572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:18.684246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:18.842765 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:18.852078 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0096d987-a34b-445f-983a-62aff5d1bf70 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.181766 May 10 20:18:18.854479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 95/190] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:18 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:19.870750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:19.871617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:19.877842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:19.887667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:19.887667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:19.887667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:20.355992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:20.372357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d381a2aa-1ff1-4a6c-9d38-1a89049bb3b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.498704 May 10 20:18:20.376545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 96/191] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:19 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:21.384506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:21.385701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:21.394306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:21.394762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:21.395785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:21.396728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:21.561954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:21.569752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7d69de46-1737-493c-a2b4-2efeebf5cbc0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.189978 May 10 20:18:21.574310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 96/192] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:21 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:22.589751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:22.590392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:22.606321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:22.606980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:22.607927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:22.608513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:22.963230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:22.963230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-39260a84-33f3-4d48-a58d-7bc7fd876d91 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.377444 May 10 20:18:22.975881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 97/193] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:22 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:24.003521 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:24.004129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:24.010928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.011369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.012129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.012557 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.148359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:24.155751 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d6140311-8f44-43e4-92c8-e67dd43ef3a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1500 microversion: 2.1 time: 0.156099 May 10 20:18:24.156321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 97/194] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:23 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:24.173671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbaffa11-a2b5-4f0d-b7a0-b81bf67e54eb"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:24.174779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:24.181103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.181666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.182728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.183242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.208037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] HTTP exception thrown: Cannot 'attach_volume' instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b while it is in vm_state rescued May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Request method failure captured: May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/os-volume_attachments HTTP/1.1 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 74 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesguU84PRPrLb4L0FhSaDenHglcTDETqiJr2k5Hq2mgdPBKFLHuiDsxayhPUqrCJdQCRizrald5EKV-eQru44uODOrnFKR5SyQUecbx0zJ49xtuH7XWhJtaHFgdC0Cx7fFjqB43hilR29zEinoUUOGT_5KsBvjmcCEnpc7iXFlyBB3A May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:18:24.211787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d38de3da9e3489ebbbebd4f8aeb0d49", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 261d01f5b22340a09708c71be64edae8 May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {"volumeAttachment": {"volumeId": "dbaffa11-a2b5-4f0d-b7a0-b81bf67e54eb"}} May 10 20:18:24.213078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Cannot 'attach_volume' instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b while it is in vm_state rescued May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'server_id': '4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b', 'body': {'volumeAttachment': {'volumeId': 'dbaffa11-a2b5-4f0d-b7a0-b81bf67e54eb'}}} May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:18:24.213833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b while it is in vm_state rescued May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:18:24.215058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b while it is in vm_state rescued May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Returning 409 to user: Cannot 'attach_volume' instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b while it is in vm_state rescued {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fd5d7a41-748e-4cc2-8100-7169d497cf1b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043185 May 10 20:18:24.217435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 98/195] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:18:24 2022] POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 20:18:24.222985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:24.223504 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:24.233435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.233895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.234711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.235150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.485166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-66fa2f2a-d62a-49fa-80ff-8e293754b127 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/action" status: 202 len: 0 microversion: 2.1 time: 0.266464 May 10 20:18:24.485815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 98/196] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:18:24 2022] POST /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:18:24.505644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:24.510046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:24.528710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.529294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.530659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:24.531793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:24.836867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:24.845126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58214c87-13d0-4c59-92b8-4d73da2e0f9e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1508 microversion: 2.1 time: 0.350849 May 10 20:18:24.846018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 99/197] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:24 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:25.296537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a638c4c7-1446-43f8-909d-15b58dc4ab14 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'create', calling method: .version_select at 0x7f6029d2b8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1132298356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfiO7H/rfoZ0kJqGRTmD7XRj1SKcG2LtjmbGfuCONpajG1v85ZWX2nVhMSz5pWEIDxBQgM2E+Fgj7uD4/LtKibsfNEjKhW0kIhMda9Pi8SSXVTmDIrk7WsjTJvjceKNvw=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:25.312205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-a638c4c7-1446-43f8-909d-15b58dc4ab14 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Getting quotas for project b135986dfe1f499a9655ac3faee4bbbf. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:18:25.316711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-a638c4c7-1446-43f8-909d-15b58dc4ab14 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Getting quotas for user 6f5b649235d646fea59e7e61e7e6d8a9 and project b135986dfe1f499a9655ac3faee4bbbf. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:18:25.422369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a638c4c7-1446-43f8-909d-15b58dc4ab14 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.121543 May 10 20:18:25.422369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 99/198] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:18:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:25.622363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1247867466", "imageRef": "039c9439-5fb8-41d7-a106-ca9f85ac990c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1132298356", "networks": [{"uuid": "763cc9b3-6f11-4887-bac8-beaf82ec0ec6"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:25.685108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] validate_networks() for [('763cc9b3-6f11-4887-bac8-beaf82ec0ec6', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:18:25.863753 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:25.865925 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:25.882996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:25.883689 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:25.884683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:25.885442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:26.140451 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:26.147167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:18:26.147808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:18:26.148378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:18:26.148884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:18:26.149518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:18:26.158350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e4351e86-4b89-41f0-a478-651a93215531 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1508 microversion: 2.1 time: 0.298747 May 10 20:18:26.159288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 100/199] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:25 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:26.160023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:26.160484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:26.161387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:26.163485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:26.183083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Getting quotas for project b135986dfe1f499a9655ac3faee4bbbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:18:26.187952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Getting quotas for user 6f5b649235d646fea59e7e61e7e6d8a9 and project b135986dfe1f499a9655ac3faee4bbbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:18:26.216216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:18:26.216216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='039c9439-5fb8-41d7-a106-ca9f85ac990c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:18:26.390244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-543e5c67-91f7-4d88-aca3-ef4b2feb7fb3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768484 May 10 20:18:26.390244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 100/200] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 20:18:26.401315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5093d6ab-1cb3-4bef-9cb1-bdbfc26d42e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:26.402245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5093d6ab-1cb3-4bef-9cb1-bdbfc26d42e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:26.470722 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5093d6ab-1cb3-4bef-9cb1-bdbfc26d42e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:26.497936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5093d6ab-1cb3-4bef-9cb1-bdbfc26d42e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1259 microversion: 2.1 time: 0.102108 May 10 20:18:26.498756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 101/201] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:26 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1259 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:27.181053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:27.181053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:27.185107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:27.185552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:27.186795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:27.187404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:27.339460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:27.348530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c5baca90-5f43-4901-8061-ab6b4a202728 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1508 microversion: 2.1 time: 0.174670 May 10 20:18:27.348530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 101/202] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:27 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:27.515424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-817d5b14-d29a-4541-9f7d-69c113d24f9b tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:27.516037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-817d5b14-d29a-4541-9f7d-69c113d24f9b tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:27.573810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-817d5b14-d29a-4541-9f7d-69c113d24f9b tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:27.583465 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-817d5b14-d29a-4541-9f7d-69c113d24f9b tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1259 microversion: 2.1 time: 0.071841 May 10 20:18:27.584543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 102/203] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:27 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:28.363944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:28.364552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:28.371115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:28.371564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:28.372337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:28.372769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:28.544565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:28.551821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c4c59ac1-3b6a-40c7-a217-635349f734a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1514 microversion: 2.1 time: 0.191623 May 10 20:18:28.552396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 102/204] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:28 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:28.601792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:28.601792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:28.608448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:28.609101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:28.610009 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:28.610706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:28.696377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:28.707360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ad4aa97e-5801-41c1-be94-ab72fed0ffb7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1311 microversion: 2.1 time: 0.111285 May 10 20:18:28.708535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 103/205] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:28 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:29.727733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:29.728925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:29.776078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:29.776078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:29.776078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:29.776078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:29.856552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:29.864195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-657f8416-55f8-46a3-a232-a11edcae86b0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1317 microversion: 2.1 time: 0.142911 May 10 20:18:29.865020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 103/206] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:29 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:30.327360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2076337d-5f8e-4afe-bebe-ba39d38769a0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: .version_select at 0x7f602929e280>, body: {"keypair": {"name": "tempest-keypair-48266751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ07wKNspgqAaffujf9+0i/VqXPanpRlkNmVdDS1jza5xiywfYKFvFnNYjK9Y9ax5uwOWgpItStF7GM8bqX3nDyhk2YcvwNGwpkbQlvIHkVNgXr/1MSUmOO+wPfwvP3Buw=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:30.365189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-2076337d-5f8e-4afe-bebe-ba39d38769a0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:18:30.371740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-2076337d-5f8e-4afe-bebe-ba39d38769a0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for user 261d01f5b22340a09708c71be64edae8 and project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:18:30.509541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2076337d-5f8e-4afe-bebe-ba39d38769a0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.188460 May 10 20:18:30.511693 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 104/207] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:18:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:30.883192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:30.884055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:30.894384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:30.896478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:30.900513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:30.902189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:31.252839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:31.262031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ee6813a-ccd5-4413-884c-a69688c0ab6f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.384791 May 10 20:18:31.262666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 104/208] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:30 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:32.161862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-2d60d3f0-da69-4de8-84d2-05ef202e91b8 req-40120389-77a8-4424-9cb7-2c6a6f201cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:32.184462 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2d60d3f0-da69-4de8-84d2-05ef202e91b8 req-40120389-77a8-4424-9cb7-2c6a6f201cd5 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:32.185469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2d60d3f0-da69-4de8-84d2-05ef202e91b8 req-40120389-77a8-4424-9cb7-2c6a6f201cd5 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:32.244532 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-2d60d3f0-da69-4de8-84d2-05ef202e91b8 req-40120389-77a8-4424-9cb7-2c6a6f201cd5 service nova] Creating event network-changed:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:18:32.255890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-2d60d3f0-da69-4de8-84d2-05ef202e91b8 req-40120389-77a8-4424-9cb7-2c6a6f201cd5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097959 May 10 20:18:32.266340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 105/209] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:32.280875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:32.281607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:32.296242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:32.305515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:32.305515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:32.305515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:32.626733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:32.647362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0bb700d4-fcb5-4d0e-9d61-018b9d98c505 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.361595 May 10 20:18:32.658709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 105/210] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:32 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:33.681039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:33.682691 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:33.701500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:33.701952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:33.702814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:33.703247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:33.965769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:33.973249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7cc9df19-3c44-4eda-af96-c014187ed181 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.308045 May 10 20:18:33.973844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 106/211] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:33 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:34.263456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:34.265595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:34.283009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:34.283476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:34.286282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:34.287059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:34.326963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8d3bd78e-b569-4798-bf94-3e97544a89d8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/ips" status: 200 len: 144 microversion: 2.1 time: 0.070593 May 10 20:18:34.327633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 106/212] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:18:34 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/ips => generated 144 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:34.350866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-873853146", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b1220fb-9a6d-4fc5-8525-c6ec85061eb5"}], "security_groups": [{"name": "tempest-securitygroup--382095368"}], "key_name": "tempest-keypair-48266751", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:34.468949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] validate_networks() for [('3b1220fb-9a6d-4fc5-8525-c6ec85061eb5', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:18:34.967963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:18:34.968572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:18:34.969050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:18:34.969579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:18:34.970110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:18:34.980199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:34.980759 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:34.981702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:34.982332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:34.994106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:34.998565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:35.002419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.003288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.004376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.004955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.027162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:18:35.034951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Getting quotas for user 261d01f5b22340a09708c71be64edae8 and project 9d38de3da9e3489ebbbebd4f8aeb0d49. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:18:35.063325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:18:35.067312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:18:35.245951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-70764fa0-28b5-4ce7-aa8c-75783ccd3f8d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.904761 May 10 20:18:35.251506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 107/213] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:18:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:18:35.252037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:35.277878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-614bf6c2-2946-4623-99fd-a549f2c1a4d4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.285625 May 10 20:18:35.278628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 107/214] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:34 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:35.284368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4ac525fa-f020-43bc-b0bd-c0bfc601527b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:35.285630 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4ac525fa-f020-43bc-b0bd-c0bfc601527b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:35.361494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4ac525fa-f020-43bc-b0bd-c0bfc601527b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:35.380043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4ac525fa-f020-43bc-b0bd-c0bfc601527b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1243 microversion: 2.1 time: 0.107576 May 10 20:18:35.396129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 108/215] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:35 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1243 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:36.294853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:36.295611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:36.304810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.307892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.309079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.310311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.380795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:36.381399 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:36.395863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.396658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.397680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.398303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.429690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c1239d5c-a7e2-42e0-b920-477fcf4fb45a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/ips" status: 200 len: 153 microversion: 2.20 time: 0.050041 May 10 20:18:36.429690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 109/216] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 10 20:18:36 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:18:36.459373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:36.460686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:36.468873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.469688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.471120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:36.471811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:36.544905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:36.558941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0718e98b-bcff-4810-bafb-0cac2c4a6202 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.267918 May 10 20:18:36.570450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 108/217] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:36 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:36.582670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:36.595634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d6b2b6f3-508f-43db-b129-daa99b140018 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1247 microversion: 2.1 time: 0.166813 May 10 20:18:36.610169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 110/218] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:36 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1247 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:37.579163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:37.580021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:37.588321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:37.589320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:37.592313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:37.593036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:37.617658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:37.619140 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:37.627274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:37.628385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:37.630475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:37.632605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:37.712246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:37.718199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-583fc574-053e-4426-8293-5e241641e80d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1247 microversion: 2.1 time: 0.105153 May 10 20:18:37.719086 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 111/219] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:37 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1247 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:37.803575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:37.815967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b4cd83d6-7178-4a6a-8a14-81c7555a6164 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.243619 May 10 20:18:37.818295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 109/220] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:37 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:38.736235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:38.737096 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:38.749500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:38.750182 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:38.751259 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:38.751904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:38.832446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:38.839727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:38.841818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:38.852481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-26cac593-2726-4ef2-9f2a-59173ceb535e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1247 microversion: 2.1 time: 0.120557 May 10 20:18:38.862200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 112/221] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:38 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1247 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:38.862402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:38.862402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:38.863092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:38.863309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:39.059287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:39.071942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-66d609e2-0425-480b-96f2-33166a264851 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.236603 May 10 20:18:39.072542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 110/222] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:38 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:39.345676 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e38b50c-14e8-4c1d-b365-eb11a5da8088"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:39.346985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:39.353379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:39.354233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:39.355383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:39.356038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:39.772084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:39.772578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:39.779778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:39.780485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:39.790614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:39.792113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:39.819237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lazy-loading 'flavor' on Instance uuid 5ab6f0a6-aa14-407a-b43d-7b7d2855499d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:18:40.694887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b993e22b-e188-4e9c-a8d2-954bf6785e9b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/action" status: 202 len: 0 microversion: 2.20 time: 0.926591 May 10 20:18:40.711066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 111/223] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 20:18:39 2022] POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:18:40.719917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:40.721107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:40.729987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:40.730812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:40.731397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:40.731992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:40.841437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:40.850040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-072719d4-be56-4d9f-9eb8-26d323486e58 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1247 microversion: 2.1 time: 0.136982 May 10 20:18:40.851534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 112/224] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:40 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1247 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:40.861987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:40.862647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:40.871455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:40.871911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:40.872808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:40.873246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:41.048655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:41.060453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a924e916-4c93-4f6f-b9b6-6caef23d7ecd tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.207683 May 10 20:18:41.061629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 113/225] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:40 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:41.067203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:41.068265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:41.087940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:41.088600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:41.090607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:41.092696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:41.376324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:41.384890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:41.387390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:41.388821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a1b2f29-3b85-4ecf-a22b-519d3addb538 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.325971 May 10 20:18:41.389642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 114/226] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:41 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:41.869691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:41.870348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:41.876585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:41.877041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:41.877829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:41.878352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:41.998515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:42.008463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96627c8c-260c-4712-afda-84c5598e54ec tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1247 microversion: 2.1 time: 0.143930 May 10 20:18:42.009043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 115/227] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:41 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1247 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:42.080240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:42.082056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:42.103519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:42.103878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:42.104845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:42.105457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:42.289024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:42.297540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9434bb1-bca9-41e6-8f2d-71982d5dca95 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.223271 May 10 20:18:42.298315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 116/228] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:42 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:42.408926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:42.410814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:42.415973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:42.416426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:42.417193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:42.417688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:42.621119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:42.632088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:42.634455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:42.636590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1e10aeb8-63b5-4c08-a094-1f84bd10677d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.230894 May 10 20:18:42.638073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 117/229] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:42 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:18:43.025356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:43.026026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:43.032734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.033278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.034065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.034528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.097647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:43.106826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8bb0ca6a-281a-4e47-8d32-968c943d87fd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1295 microversion: 2.1 time: 0.085968 May 10 20:18:43.107415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 118/230] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:43 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:43.302883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-998a9640-46bb-473e-b5f7-516c950874b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.961043 May 10 20:18:43.306613 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 113/231] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:18:39 2022] POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments => generated 194 bytes in 3963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:43.314773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:43.315732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:43.333067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.333593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.334431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.334877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.552073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:43.562042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2e7db90e-4a72-4d24-a7b1-5a142c2bac18 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.250693 May 10 20:18:43.574262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 119/232] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:43 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:43.656427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:43.657132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:43.663245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.663701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.665109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:43.665555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:43.860125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:43.881149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:43.885742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:43.888602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bff16d31-1c05-4715-bbef-79776a09176d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.235904 May 10 20:18:43.902933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 114/233] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:43 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:44.124298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:44.124898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:44.135011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.135765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:44.136732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.137334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:44.267819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:44.288434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c6a921d-92f4-4740-a2f4-8db9b7e24cbe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1295 microversion: 2.1 time: 0.167778 May 10 20:18:44.291539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 120/234] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:44 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1295 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:44.579968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:44.580585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:44.587457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.588102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:44.588882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.589318 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:44.801544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:44.813038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2bc8faf9-bab9-4ca5-b674-93d6f89c1104 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.236925 May 10 20:18:44.814493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 115/235] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:44 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:44.913095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:44.913776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:44.921058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.921509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:44.924658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:44.925094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:45.312051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:45.312969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:45.328744 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:45.329445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:45.331433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:45.332100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:45.453083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:45.465275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-83a2a734-dd71-48ea-aab7-0d782b6b4abe tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1301 microversion: 2.1 time: 0.161254 May 10 20:18:45.478277 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 116/236] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:45 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1301 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:45.533396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:45.565662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:45.574511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:45.574718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3576b0ee-8ed3-4b4a-9490-dac0784cb621 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.665518 May 10 20:18:45.577950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 121/237] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:44 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:45.831136 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:45.831136 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:45.843412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:45.843865 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:45.844654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:45.845086 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:46.100864 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:46.120935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a51436cc-131f-41ca-a227-77819e2d061f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.292597 May 10 20:18:46.129099 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 117/238] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:45 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:46.482765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:46.483848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:46.490490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:46.491168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:46.492348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:46.493743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:46.596189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:46.596900 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:46.609048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:46.609801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:46.610861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:46.616300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:46.994247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:47.003030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:47.004835 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:47.006176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1a79f310-da2a-4f1d-b411-b8903f0b6a8f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.414855 May 10 20:18:47.006852 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 118/239] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:46 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:18:47.139475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:47.140369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:47.147163 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:47.147835 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:47.148646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:47.149934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:47.319901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:47.319901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-642c1b53-05be-4890-94e0-85d243dd8014 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.791320 May 10 20:18:47.319901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 122/240] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:46 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:47.321246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:47.321246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ee45790e-7453-402e-b939-10c56bcbeccc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.179829 May 10 20:18:47.321246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 119/241] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:47 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:48.032803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:48.033415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:48.046147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.046566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.050254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.050728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.243392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f707ce1f-b50f-4cdb-8a88-8271eb3f420c req-7eb2dfe4-ce98-45b3-b245-98660a7b0371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "name": "network-vif-plugged", "status": "completed", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:48.252943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f707ce1f-b50f-4cdb-8a88-8271eb3f420c req-7eb2dfe4-ce98-45b3-b245-98660a7b0371 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.253406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f707ce1f-b50f-4cdb-8a88-8271eb3f420c req-7eb2dfe4-ce98-45b3-b245-98660a7b0371 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.266197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f707ce1f-b50f-4cdb-8a88-8271eb3f420c req-7eb2dfe4-ce98-45b3-b245-98660a7b0371 service nova] Creating event network-vif-plugged:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:18:48.271302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f707ce1f-b50f-4cdb-8a88-8271eb3f420c req-7eb2dfe4-ce98-45b3-b245-98660a7b0371 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 May 10 20:18:48.272057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 120/242] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:18:48.315620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:48.316460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:48.333243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.335212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.336991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.337600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.392913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:48.402859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:48.408199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:48.418074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-60260f16-5b98-42b1-8980-76471dcdd786 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.383180 May 10 20:18:48.418074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 123/243] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:48 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:48.422288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:48.440291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:48.449236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.449236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.449506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:48.449855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:48.619670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:48.633872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3e0b473d-d5af-4f6e-bff8-19b64ee8a46e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.321820 May 10 20:18:48.636366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 121/244] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:48 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:48.826646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:48.833960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bf357cfc-cdfe-44ce-a829-f2664b05f2ad tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.418337 May 10 20:18:48.834565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 124/245] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:48 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:49.136872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1457085371", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "networks": [{"uuid": "3bb2c490-f5c2-46ac-b9c0-c30485604258"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:49.187551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] validate_networks() for [('3bb2c490-f5c2-46ac-b9c0-c30485604258', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:18:49.396105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-f7a8c70c-c4e7-4c5b-90c0-b88370d64f24 req-acf1f147-00a4-4ece-8c7e-7784f8f6d350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:49.416472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-f7a8c70c-c4e7-4c5b-90c0-b88370d64f24 req-acf1f147-00a4-4ece-8c7e-7784f8f6d350 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:49.418860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-f7a8c70c-c4e7-4c5b-90c0-b88370d64f24 req-acf1f147-00a4-4ece-8c7e-7784f8f6d350 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:49.442245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-f7a8c70c-c4e7-4c5b-90c0-b88370d64f24 req-acf1f147-00a4-4ece-8c7e-7784f8f6d350 service nova] Creating event network-changed:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:18:49.449606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-f7a8c70c-c4e7-4c5b-90c0-b88370d64f24 req-acf1f147-00a4-4ece-8c7e-7784f8f6d350 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057968 May 10 20:18:49.450722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 125/246] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:49.462844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:49.463711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:49.474437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:49.484234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:49.484234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:49.484234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:49.871374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:18:49.871985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:18:49.872818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:18:49.873398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:18:49.874127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:18:49.889094 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:49.889868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:49.891271 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:49.893018 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:49.912321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Getting quotas for project 752cb97b116941b7bc7ef28b2e796b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:18:49.916921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Getting quotas for user e98e849891bf45768936056e3206d880 and project 752cb97b116941b7bc7ef28b2e796b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:18:49.929479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:18:49.932024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:18:50.068228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7eccb940-a4d7-48b8-a906-ac0d2a1c8b72 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935868 May 10 20:18:50.069443 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 122/247] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:18:50.074836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:50.075967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:50.083663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:50.084445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:50.085876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:50.087502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:50.188196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.199459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.204431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.205632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fcd73bca-2c29-4204-be44-e83997e483e1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.753606 May 10 20:18:50.208460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 126/248] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:49 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:50.213173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:50.213940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:50.232553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:50.232914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:50.233894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:50.234445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:50.356036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.365704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3c6b3e1f-1a8a-4486-94b8-38bbc7df4057 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.295081 May 10 20:18:50.367305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 123/249] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:50 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:50.380428 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e2579bd-43f7-4f92-9e94-5329c169111e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:50.381035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e2579bd-43f7-4f92-9e94-5329c169111e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:50.448328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7e2579bd-43f7-4f92-9e94-5329c169111e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.453862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e2579bd-43f7-4f92-9e94-5329c169111e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1214 microversion: 2.1 time: 0.077418 May 10 20:18:50.454487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 124/250] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:50 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:50.542655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:50.559042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1544ffca-131e-4402-9782-7bac3846b826 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1359 microversion: 2.1 time: 0.349337 May 10 20:18:50.568939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 127/251] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:50 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:51.226683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:51.229228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:51.236628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.237856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.240457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.241143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.394827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:51.394827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:51.406497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.407521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.409388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.409842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.437772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.448236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.449963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.452906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0844eb3a-6d56-4662-bd44-3734b444e128 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.229189 May 10 20:18:51.452906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 125/252] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:51 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:51.471993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-890bde6e-980f-4ca8-a598-41ac43d1a30d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:51.472919 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-890bde6e-980f-4ca8-a598-41ac43d1a30d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:51.561968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-890bde6e-980f-4ca8-a598-41ac43d1a30d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.571621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-890bde6e-980f-4ca8-a598-41ac43d1a30d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1214 microversion: 2.1 time: 0.101842 May 10 20:18:51.575398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 126/253] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:51 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:51.583044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:51.583659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:51.599499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.599946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.600740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.601175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.810887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.830646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7866e6c3-14a8-46e4-a040-4e387724ceb1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1548 microversion: 2.1 time: 0.253743 May 10 20:18:51.831064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 127/254] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:51 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1548 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:51.850714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:51.851632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:51.876236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.878015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.878998 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:51.879442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:51.919897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:51.927948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1ff33ec6-fce9-4b2b-9a3e-daaa18b2051b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.547277 May 10 20:18:51.932092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 128/255] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:51 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:52.106555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.119106 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f935caa5-623d-41b8-8f06-8be11ad734d6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1548 microversion: 2.1 time: 0.271233 May 10 20:18:52.120482 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 128/256] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:51 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1548 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:52.136612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:52.140166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.141431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Searching by: {'deleted': False, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf'} {{(pid=117754) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 20:18:52.148325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.148776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.149691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.150138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.324016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.multi_cell_list [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117754) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 20:18:52.470986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:52.471603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:52.481340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.481789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.486208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.486663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.489174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-393b378d-dcc0-4aa9-9769-b2cf7c2e2adf tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.357050 May 10 20:18:52.496324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 129/257] 10.222.0.65 () {58 vars in 1124 bytes} [Tue May 10 20:18:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:52.501544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:52.510040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:52.519440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.520313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.521322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.521958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.718423 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.727952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.729915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.731373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d0b3799d-fe3f-4b99-882f-e483a014eb36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.265390 May 10 20:18:52.734478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 129/258] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:52 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:18:52.751236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-723ff947-c4a1-4b5e-9806-648b0503f5bd tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:52.758409 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-723ff947-c4a1-4b5e-9806-648b0503f5bd tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.762036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-723ff947-c4a1-4b5e-9806-648b0503f5bd tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.769184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.777272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8f616db-3f68-40e9-923c-55e6801b30b3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1548 microversion: 2.1 time: 0.279544 May 10 20:18:52.788306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 130/259] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:52 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:52.794020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:52.794846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:52.801943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.802628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.803651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.804297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.865499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-723ff947-c4a1-4b5e-9806-648b0503f5bd tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Going to try to stop instance {{(pid=117755) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 20:18:52.919962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:52.928424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d1b0729-e09c-4363-952b-044da8253891 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1266 microversion: 2.1 time: 0.138922 May 10 20:18:52.929253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 131/260] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:52 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:52.947468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:52.948128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:52.955226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.955670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:52.956457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:52.956884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.146592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-723ff947-c4a1-4b5e-9806-648b0503f5bd tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.410295 May 10 20:18:53.150022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 130/261] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:18:52 2022] POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:18:53.156770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:53.157553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:53.164229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.165270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.166434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.166991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.191180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:53.199258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d1a936f6-9464-462d-ad4d-4e7e52999e87 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.256946 May 10 20:18:53.200052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 132/262] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:52 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:53.359157 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:53.378525 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-83da3b4c-128b-4795-b2ae-9723287c5294 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.224831 May 10 20:18:53.378525 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 131/263] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:53 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:53.754655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:53.756557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:53.766490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.767508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.770507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.771905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.951528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:53.953466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:53.963941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.964485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.966570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:53.967089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:53.992241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.003672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.005187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.006412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-15b575f4-4030-4847-bcb2-c23b2130e31e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.256982 May 10 20:18:54.006955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 133/264] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:53 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:54.071537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.079246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2a95dcd4-8a20-4d4e-a5ee-e0f865d134a9 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1274 microversion: 2.1 time: 0.133119 May 10 20:18:54.080140 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 132/265] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:53 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:54.217390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:54.222033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:54.232157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.232673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:54.233776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.234260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:54.396736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.407158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:54.407892 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:54.411375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-59f079e7-47ec-432c-8b1c-def6df9a7da8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.197456 May 10 20:18:54.412313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 134/266] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:54 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:54.416174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.425801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:54.425801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.425801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:54.644347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:54.661995 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bf3e45a3-0889-4016-8b4e-b65a0d5a3195 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.263198 May 10 20:18:54.674125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 133/267] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:54 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:54.986554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0510b34b-ab38-468a-8c2f-eef335df1815"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:54.987964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:54.994773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.995476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:54.996301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:54.996829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.025267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:55.026533 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:55.042869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.043507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.044474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.045065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.320313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.329550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.331070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.332953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2cbeb2d1-6788-4b90-8886-c42d027d951f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.312062 May 10 20:18:55.333672 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 134/268] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:55 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:55.339216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:55.340181 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:55.349597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.350395 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.351452 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.352054 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.559611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.570247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9662fab7-b9d3-4839-85fa-4c799241aae2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.233522 May 10 20:18:55.571178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 135/269] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:55 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:55.595868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:55.597081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:55.610062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.610553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.611392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.611830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.755639 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.764363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fe879ebb-80b1-479a-9ce9-c89ce5fc4f13 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.191649 May 10 20:18:55.774436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 136/270] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:55 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:55.779547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:55.780218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:55.797495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.798585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.799523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:55.799975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:55.976743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:55.986502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a2ca7e2-36b4-48eb-8cc4-bc9c640cda21 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.210567 May 10 20:18:55.987583 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 137/271] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:55 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:56.352350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:56.354149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:56.365435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.365435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:56.375990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.376815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:56.613384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:56.627994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:56.630584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:56.632065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1e937c75-fb78-40cf-8207-6bf244d529d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.283912 May 10 20:18:56.633260 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 138/272] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:56 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:18:56.639798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:56.640888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:56.648309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.651470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:56.651470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.651470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:56.827627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:56.838535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a7b50890-acb8-48ae-b212-6ba6e2729082 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.203180 May 10 20:18:56.848191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 139/273] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:56 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:56.853078 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:56.853761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:56.862387 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.862859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:56.863792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:56.864245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.022611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:57.031548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-92abc335-4d04-4931-9e55-afc157941060 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.183782 May 10 20:18:57.032341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 140/274] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:56 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:57.042431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:57.043449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:57.050323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.051014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.052286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.053095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.353225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:57.365407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-52e723ca-c859-4029-895f-72fecb2a1f48 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.331636 May 10 20:18:57.367173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 141/275] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:57 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:57.653828 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:57.654481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:57.669529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.672075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.678736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.679229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.860184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:57.868036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:57.870099 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:57.871300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b43444ff-0eb3-4e6b-9e0d-67fe4414e0d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.222249 May 10 20:18:57.872211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 142/276] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:57 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:57.888193 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:57.888827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:57.894965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.895615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:57.896643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:57.897240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.004761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d039cc19-8c4a-431d-8c0c-7654e9733da2 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.021218 May 10 20:18:58.005816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 135/277] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:18:54 2022] POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 194 bytes in 3024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:58.063437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:58.065507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:58.066866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:58.073475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aeebf9f0-9015-42e1-96e8-5a3f3f852e1a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.199819 May 10 20:18:58.076857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 143/278] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:57 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:58.080864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.082198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.083473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.084299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.385627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:58.387080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:58.393840 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.394455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.395359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.395902 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.487227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:58.499374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7334cd0f-5098-459b-9a28-19827ab83a67 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.454190 May 10 20:18:58.500359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 136/279] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:58 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:58.578403 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:58.588085 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-41135c31-3495-4828-9f75-952724f6bc3d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.206489 May 10 20:18:58.607544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 144/280] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:58 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:18:58.891496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:58.892457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:58.902330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-60f2e733-a021-4016-9420-26f1eb1d2569 req-fd093cbe-2613-4fae-bcd6-f2caff32192a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76633cc-cfa9-4b73-b4d7-ca9d412144d0", "tag": "6af8c166-5d5a-49fc-8b05-cfa52d164e50"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:58.906566 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.907311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.908489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.909153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.934711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-60f2e733-a021-4016-9420-26f1eb1d2569 req-fd093cbe-2613-4fae-bcd6-f2caff32192a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:58.935572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-60f2e733-a021-4016-9420-26f1eb1d2569 req-fd093cbe-2613-4fae-bcd6-f2caff32192a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:58.962504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-60f2e733-a021-4016-9420-26f1eb1d2569 req-fd093cbe-2613-4fae-bcd6-f2caff32192a service nova] Creating event network-changed:6af8c166-5d5a-49fc-8b05-cfa52d164e50 for instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 on hv-cinder-82880 May 10 20:18:58.985002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-60f2e733-a021-4016-9420-26f1eb1d2569 req-fd093cbe-2613-4fae-bcd6-f2caff32192a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109990 May 10 20:18:58.991063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 137/281] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:59.092100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:59.092817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:59.099860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.100509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.111385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.113128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.259638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.270006 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.272447 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.274275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dc32313a-ab0d-4696-97fe-fd502ccc4180 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.386516 May 10 20:18:59.287886 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 145/282] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:18:58 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:18:59.365042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.372363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-37a27489-2aa7-4884-b0c9-56e3faa3985d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.284414 May 10 20:18:59.375502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 138/283] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:59 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:59.404255 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-c9a88f3e-469d-4423-ab09-eeeb019d25bb req-7780a3cc-d036-410a-beed-33339cadcd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "name": "network-vif-plugged", "status": "completed", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:18:59.416624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-c9a88f3e-469d-4423-ab09-eeeb019d25bb req-7780a3cc-d036-410a-beed-33339cadcd90 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.417302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-c9a88f3e-469d-4423-ab09-eeeb019d25bb req-7780a3cc-d036-410a-beed-33339cadcd90 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.434726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-c9a88f3e-469d-4423-ab09-eeeb019d25bb req-7780a3cc-d036-410a-beed-33339cadcd90 service nova] Creating event network-vif-plugged:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:18:59.440442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-c9a88f3e-469d-4423-ab09-eeeb019d25bb req-7780a3cc-d036-410a-beed-33339cadcd90 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040444 May 10 20:18:59.441539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 146/284] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:59.516583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:59.517196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:59.523631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.524076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.525364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.525821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.607510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:59.608208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:18:59.614370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.614862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.615668 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:59.616106 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:59.763834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.777121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f9a14f03-4e16-426a-870f-df8ba36a865c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.264288 May 10 20:18:59.787597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 139/285] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:59 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:18:59.787903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:18:59.803534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-768b7f0c-caf0-4ebd-8703-43cd7ce26073 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.201363 May 10 20:18:59.804762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 147/286] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:18:59 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:00.292597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:00.293214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:00.308398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.308852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.309632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.310065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.392738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:00.393512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:00.400811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.401473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.402315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.402989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.526377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:00.541912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:00.550402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:00.552046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a2da729-5c79-4c4a-a292-02c57071263c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.263343 May 10 20:19:00.554356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 140/287] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:00 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:00.608002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:00.621974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3f3c7596-a202-4d4f-afdc-52f76a3e7f2b tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.233969 May 10 20:19:00.623104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 148/288] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:00 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:00.795222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:00.795838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:00.808828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.809286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.810070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.810544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.825155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:00.825831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:00.837107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.838132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:00.838933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:00.842247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:01.035089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:01.039369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:01.048724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a07e662-3b92-4aa4-bf82-0f73dc709af3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.257235 May 10 20:19:01.048888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6cf41bae-632a-4be5-ab4a-3c3f804ff331 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.228007 May 10 20:19:01.049595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 141/289] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:00 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:01.049954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 149/290] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:00 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:01.572651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:01.573414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:01.579780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:01.580229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:01.581253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:01.581686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:01.640070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:01.640687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:01.647488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:01.647943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:01.648733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:01.649167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:01.829949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:01.842046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e4b159d0-9107-4880-87f0-56faeeac0914 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.206269 May 10 20:19:01.842936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 150/291] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:01 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:01.991394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:02.005340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:02.005487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:02.007140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5149b880-cdf2-4e3f-b07b-9e352e395d31 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.438515 May 10 20:19:02.007949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 142/292] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:01 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:02.066519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:02.067082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:02.067886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:02.068009 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:02.074675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.074884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.075320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:02.075668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:02.076888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.077275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.077485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:02.078163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:02.286433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:02.296601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8692bf7e-d07c-41e6-8ed1-fbb4efef37ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.235119 May 10 20:19:02.297621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 151/293] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:02 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:02.569914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:02.580038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-24b98e79-5746-48c0-a7f8-48802e283bbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.517066 May 10 20:19:02.593475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 143/294] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:02 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:02.859874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:02.860387 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:02.872692 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.873137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:02.873915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:02.884166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.028196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:03.030628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:03.038341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.039143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.040216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.044472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.101839 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.124890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0c04c587-c616-4329-8ed6-7bc988616b52 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.268968 May 10 20:19:03.128112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 152/295] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:02 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:03.228400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.239066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.241605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.243317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fdba7922-99ba-43b4-bbf7-bebae0521439 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.220891 May 10 20:19:03.245772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 144/296] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:03 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:03.314928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:03.316087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:03.323491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.324165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.324945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.325379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.497830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.506944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-46359428-8b59-4f99-b70c-bc34179f028c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.196097 May 10 20:19:03.514866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 145/297] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:03 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:03.515773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bf8c9aff-4912-4e81-a7f8-77b6eecb7cbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Action: 'create', calling method: .version_select at 0x7f60291c9ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2092652250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVM7HALL3GHnCEqc69TRfM+sGvGJUkM3oyXYEeywRJcJ74dqmsonsqKHuII21+8if9aXl9V+b4AB7QrCAX5C82umHapYUttjODimdVXl0RtsuG2M2CObgwS4Hs3+8Ufqg=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:03.533339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-bf8c9aff-4912-4e81-a7f8-77b6eecb7cbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Getting quotas for project b9724c9a575141d48bbfbde685774622. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:19:03.538370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-bf8c9aff-4912-4e81-a7f8-77b6eecb7cbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Getting quotas for user f213f79341ab4462b3d51352ccb9de2c and project b9724c9a575141d48bbfbde685774622. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:19:03.598820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:03.599440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:03.605532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.605993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.606797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:03.607234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:03.647303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bf8c9aff-4912-4e81-a7f8-77b6eecb7cbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.489600 May 10 20:19:03.648266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 153/298] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:19:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:19:03.757600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:03.775095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7bacb41-cb23-431c-8bc1-7d96bb1dd747 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.179692 May 10 20:19:03.779064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 146/299] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:03 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:04.145683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:04.146957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:04.153380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.154042 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.155070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.155647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.266290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:04.267592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:04.275863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.276531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.277505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.278314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.360628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:04.368602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e9ee8387-3a60-437a-9aad-549839ba1a9a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.227601 May 10 20:19:04.369826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 154/300] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:04 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:04.429804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:04.450937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:04.459177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:04.460426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a4b5b52-f23a-4d78-a635-c6ebd265e8a7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.201201 May 10 20:19:04.460991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 147/301] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:04 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:04.526113 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:04.526850 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:04.546815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.547274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.548236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.548682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.760781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:04.771273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-acd2b55b-7478-4f29-823d-7c2209620906 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.251682 May 10 20:19:04.771854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 155/302] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:04 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:04.798709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:04.799483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:04.806302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.806894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:04.807768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:04.808308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.013012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.022051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-13ff3ec4-0a19-43ed-95bf-f595eacdf661 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.227619 May 10 20:19:05.033334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 148/303] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:04 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:05.387243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:05.388652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:05.395290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.395696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.396481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.396918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.488075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:05.489532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:05.497947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.498556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.499445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.500023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.699282 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.707610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-63186b4d-f426-4907-861a-cd14654bf75d tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.325085 May 10 20:19:05.711313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 156/304] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:05 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:05.769499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.781342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.785974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.787481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a67d50d-7135-4158-b1ca-23cf1a63e56c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.311338 May 10 20:19:05.788162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 149/305] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:05 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:05.791820 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:05.792444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:05.808929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.808929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.808929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:05.808929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:05.985256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:05.993075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-91276f0e-5570-46e8-b18a-e3709dfc3296 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.206630 May 10 20:19:05.994076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 157/306] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:05 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:06.049564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:06.049564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:06.053908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.054435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.055567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.056187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.449681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:06.453233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fe3b7e98-8e89-4a86-8473-229717b63458 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.416360 May 10 20:19:06.453867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 150/307] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:06 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:06.730602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:06.732741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:06.743367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.745559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.746549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.747146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.809710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:06.810733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:06.820537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.821270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.822545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:06.822978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:06.951386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:06.958862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a4ebfe83-d48e-4f7c-af37-20b56c345958 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.234195 May 10 20:19:06.959623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 158/308] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:06 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:06.987516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:06.995414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:06.996905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:06.998173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a2a17e6-223d-4335-915d-3a8eec106c33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.193343 May 10 20:19:06.998735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 151/309] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:06 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:07.013958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:07.014666 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:07.020475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.020929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:07.021704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.022165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:07.150268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:07.157478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e2d758e8-1a90-49ec-9708-078bcf48c8c3 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.147505 May 10 20:19:07.158113 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 159/310] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:07 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:07.469581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:07.470242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:07.476520 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.476969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:07.477778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.478249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:07.626736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:07.642513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-90538974-2000-45d9-8f5b-ad5786a49084 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.176222 May 10 20:19:07.652498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 152/311] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:07 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:07.976267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:07.977083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:07.984566 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.985083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:07.985959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:07.986743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.019089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:08.020735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:08.030798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.032287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.042186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.042186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.185638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.194332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fd34ddb6-3897-4d1d-beda-0c5f9f548680 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.221981 May 10 20:19:08.194926 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 160/312] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:07 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:08.231819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:08.234402 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:08.253322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.254177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.255414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.256805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.378104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.392449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.396232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.403058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9ecaade0-7055-424a-bcbb-e225a76a2e01 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.384312 May 10 20:19:08.410137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 153/313] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:08 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:08.483090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.490957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b5a9e78a-3068-4d2e-b2af-48acab8f39ed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1368 microversion: 2.1 time: 0.279826 May 10 20:19:08.491618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 161/314] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:08 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:08.660201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:08.660820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:08.668062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.668515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.669299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:08.670010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:08.808337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:08.816995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc88afed-f22e-4a72-9709-e5049c20bf5d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.160867 May 10 20:19:08.817574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 154/315] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:08 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:09.211543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:09.212128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:09.219212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.219595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.220496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.220927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.353067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:09.360896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6709ebbe-22dd-49b7-acdc-f5fea835ca35 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.153220 May 10 20:19:09.361476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 162/316] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:09 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:09.423118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:09.423733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:09.435104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.435546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.436499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.437113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.509138 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:09.509999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:09.516531 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.517048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.517866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.519459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.652266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:09.665464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:09.667639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:09.669135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ed653209-299e-4fac-aecf-49135c0fd1df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.250249 May 10 20:19:09.679867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:09.679867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a8e96b61-74c8-4335-b1cc-2435edc93694 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1562 microversion: 2.1 time: 0.173268 May 10 20:19:09.679867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 163/317] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:09 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:09.680562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 155/318] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:09 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:09.696581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:09.697197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:09.703968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.704431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.705206 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.705770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.785630 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d95dba20-c681-4c2a-a3bb-1da2db682ed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093235 May 10 20:19:09.786373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 164/319] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:19:09 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:09.836275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:09.837236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:09.844588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.845336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:09.847077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:09.847795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.108140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.116797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-316e3a42-492e-41f0-bab2-fb239af819b3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.285358 May 10 20:19:10.117527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 156/320] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:09 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:10.145380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:10.145989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:10.154451 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.154909 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.155733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.156176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.293124 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.301694 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5e7369ef-0d08-4231-b9ee-86216aee1dde tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1594 microversion: 2.1 time: 0.161265 May 10 20:19:10.302319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 165/321] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:10 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:10.377024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:10.377621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:10.385328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.386063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.387456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.388066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.450519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-7b738d76-679b-4df8-a617-284c76719685 req-ee40833e-81b3-4c03-9f26-9b00daad4797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "name": "network-vif-plugged", "status": "completed", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:10.461978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-7b738d76-679b-4df8-a617-284c76719685 req-ee40833e-81b3-4c03-9f26-9b00daad4797 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.462541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-7b738d76-679b-4df8-a617-284c76719685 req-ee40833e-81b3-4c03-9f26-9b00daad4797 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.475327 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-7b738d76-679b-4df8-a617-284c76719685 req-ee40833e-81b3-4c03-9f26-9b00daad4797 service nova] Creating event network-vif-plugged:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:19:10.484554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-7b738d76-679b-4df8-a617-284c76719685 req-ee40833e-81b3-4c03-9f26-9b00daad4797 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 May 10 20:19:10.484554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 166/322] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:10.548508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.558392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c37024dd-ed71-4673-a9ef-76d68dc2a259 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.185164 May 10 20:19:10.559514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 157/323] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:10 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:10.689668 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:10.690446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:10.696771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.698165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.699211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:10.699780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:10.933878 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.942549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.944470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:10.945802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bc86ea2d-6db4-4712-a4c4-749c1d4d916d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1746 microversion: 2.20 time: 0.260672 May 10 20:19:10.946501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 167/324] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:10 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1746 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:11.136386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:11.144086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:11.151369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.151855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.152709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.153627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.195363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-e9eeaa1a-7698-4bde-a8da-d12711d6b69f req-31175a1c-a5d1-454c-884a-ecc5ac5bbd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:11.204857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e9eeaa1a-7698-4bde-a8da-d12711d6b69f req-31175a1c-a5d1-454c-884a-ecc5ac5bbd95 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.205736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e9eeaa1a-7698-4bde-a8da-d12711d6b69f req-31175a1c-a5d1-454c-884a-ecc5ac5bbd95 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.251031 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-e9eeaa1a-7698-4bde-a8da-d12711d6b69f req-31175a1c-a5d1-454c-884a-ecc5ac5bbd95 service nova] Creating event network-changed:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:19:11.268649 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-e9eeaa1a-7698-4bde-a8da-d12711d6b69f req-31175a1c-a5d1-454c-884a-ecc5ac5bbd95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076032 May 10 20:19:11.271212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 168/325] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:11.374534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:11.388760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca37e7db-9c19-45ec-ab7b-7b66a360901a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.257710 May 10 20:19:11.389619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 158/326] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:11 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:11.583745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:11.583745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:11.591870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.594811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.596817 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.598270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.885306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:11.895008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-62265466-816d-47bc-94fd-07a02557c4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.322721 May 10 20:19:11.906661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 169/327] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:11 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:11.977040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:11.985519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:11.994392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.995790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:11.997145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:11.997814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:12.324020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:12.333059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:12.334611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:12.335791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c9a986fb-abad-47cc-9fd3-f006f1a7fb1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.375297 May 10 20:19:12.351407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 159/328] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:11 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:12.414119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:12.414826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:12.440786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:12.441529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:12.442556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:12.442760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:12.506017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-60170ce9-abd7-4e91-bb43-2e9afb67d48a req-7dda96e2-eded-4399-8f3a-eb76d705da1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76633cc-cfa9-4b73-b4d7-ca9d412144d0", "name": "network-vif-plugged", "status": "completed", "tag": "6af8c166-5d5a-49fc-8b05-cfa52d164e50"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:12.533687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-60170ce9-abd7-4e91-bb43-2e9afb67d48a req-7dda96e2-eded-4399-8f3a-eb76d705da1a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:12.544380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-60170ce9-abd7-4e91-bb43-2e9afb67d48a req-7dda96e2-eded-4399-8f3a-eb76d705da1a service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:12.597975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-60170ce9-abd7-4e91-bb43-2e9afb67d48a req-7dda96e2-eded-4399-8f3a-eb76d705da1a service nova] Creating event network-vif-plugged:6af8c166-5d5a-49fc-8b05-cfa52d164e50 for instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 on hv-cinder-82880 May 10 20:19:12.640454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-60170ce9-abd7-4e91-bb43-2e9afb67d48a req-7dda96e2-eded-4399-8f3a-eb76d705da1a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141535 May 10 20:19:12.644805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 160/329] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:12.916763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:12.918045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:12.926498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:12.927429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:12.929207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:12.929859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:13.142285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:13.142285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a470ff86-59e8-4e1a-b1e1-6487f5546ede tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1722 microversion: 2.1 time: 0.688134 May 10 20:19:13.142285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 170/330] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:12 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1722 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:13.200487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:13.209577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6931134e-4757-49b0-a5ea-f44e72d3f8da tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.299451 May 10 20:19:13.210104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 161/331] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:12 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:13.357622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:13.358621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:13.373707 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:13.374206 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:13.380763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:13.385180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:13.679097 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:13.688822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:13.690940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:13.692731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8b6e51da-bf4a-4a19-a5be-5a8c90a1e7fa tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.339884 May 10 20:19:13.693888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 171/332] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:13 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:14.015685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-2be2d7ae-10f3-4a36-910e-ffd2b5d2cecd req-ab942b2e-9a5c-4de8-a484-2eecf5d3f21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:14.031837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2be2d7ae-10f3-4a36-910e-ffd2b5d2cecd req-ab942b2e-9a5c-4de8-a484-2eecf5d3f21f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.035279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2be2d7ae-10f3-4a36-910e-ffd2b5d2cecd req-ab942b2e-9a5c-4de8-a484-2eecf5d3f21f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.065833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-2be2d7ae-10f3-4a36-910e-ffd2b5d2cecd req-ab942b2e-9a5c-4de8-a484-2eecf5d3f21f service nova] Creating event network-changed:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:19:14.072715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-2be2d7ae-10f3-4a36-910e-ffd2b5d2cecd req-ab942b2e-9a5c-4de8-a484-2eecf5d3f21f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060894 May 10 20:19:14.073848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 162/333] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:14.165234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:14.165870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:14.186740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.187470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.188873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.189484 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.230023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:14.230935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:14.272321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.272812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.284011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.284554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.539416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:14.549328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9981b6c7-3002-4c18-9de4-0a48ef5da15c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1699 microversion: 2.1 time: 0.393849 May 10 20:19:14.554932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 172/334] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:14 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1699 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:14.577360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cebd53f0-20f3-46c4-a5dd-10f90e294e15 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:14.584261 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cebd53f0-20f3-46c4-a5dd-10f90e294e15 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.593743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cebd53f0-20f3-46c4-a5dd-10f90e294e15 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.630524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:14.631354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cebd53f0-20f3-46c4-a5dd-10f90e294e15 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Going to try to start instance {{(pid=117755) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 20:19:14.645723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7281ed7f-f67e-4439-8756-0427b89220de tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1314 microversion: 2.1 time: 0.417462 May 10 20:19:14.658488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 163/335] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:14 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:14.713058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:14.714878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:14.728388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.729465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.730570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:14.731114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:14.991749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cebd53f0-20f3-46c4-a5dd-10f90e294e15 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.417549 May 10 20:19:14.991749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 173/336] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:19:14 2022] POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:19:15.000352 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:15.002512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:15.018592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:15.019147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:15.022872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:15.023681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:15.213670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:15.226042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:15.227730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:15.231942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a2bc085a-a546-41d3-86b9-728e9929e38f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.523298 May 10 20:19:15.247137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 164/337] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:14 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:15.580861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:15.596606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-58263321-4d90-44e5-a4aa-43a913e6013a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1708 microversion: 2.1 time: 0.599195 May 10 20:19:15.597588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 174/338] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:14 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1708 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:15.660484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:15.661120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:15.676415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:15.676879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:15.682076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:15.682835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:16.192973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:16.200748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c897c36-51df-4b98-8f64-eedf31035e78 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1499 microversion: 2.1 time: 0.545253 May 10 20:19:16.219695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 165/339] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:15 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1499 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:16.252104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:16.253117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:16.261978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:16.262527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:16.263761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:16.264627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:16.579251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:16.587368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:16.589568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:16.591203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3806c519-1531-46ae-a25d-549461cd51d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.343080 May 10 20:19:16.591772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 175/340] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:16 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:16.614569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:16.615191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:16.621489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:16.622229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:16.623254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:16.623895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:16.830147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:16.838157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bc79be4d-e6b4-45f5-9c64-72434c3337be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1708 microversion: 2.1 time: 0.227359 May 10 20:19:16.838726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 166/341] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:16 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1708 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:17.624173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:17.626234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:17.683620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:17.684402 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:17.686781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:17.688965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:17.855467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:17.856694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:17.865885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:17.868936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:17.871217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:17.871645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:17.914535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:17.923455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:17.924950 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:17.926733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-05ac8c37-1c25-4bd3-81fc-01d8da92a9d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.320316 May 10 20:19:17.927262 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 176/342] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:17 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:18.085305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:18.086145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:18.093313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.093922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.095093 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.095687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.127100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:19:18.177858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:18.187976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8b1abc1e-b0a4-4d7a-b3fa-ee185d166159 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1708 microversion: 2.1 time: 0.335951 May 10 20:19:18.192983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 167/343] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:17 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1708 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:18.440663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c21a0f89-3301-4d8a-8054-662da867c08c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 204 len: 0 microversion: 2.1 time: 0.359591 May 10 20:19:18.442356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 177/344] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:19:18 2022] DELETE /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:19:18.450272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:18.450989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:18.468780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.473737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.477578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.478222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.675999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:18.695118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82c00e7b-c452-4032-bace-298645dc3e2a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1505 microversion: 2.1 time: 0.248917 May 10 20:19:18.695899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 168/345] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:18 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:18.954368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:18.955168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:18.960580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1878486472"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:18.961745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:18.962358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.962808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.968270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.968270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.974462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.975186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:18.976135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:18.976727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:19.139887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:19.154918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:19.154918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:19.155492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5e01516b-ee02-47b3-8037-9d651f01ae76 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.208498 May 10 20:19:19.156341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 178/346] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:18 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:19.167945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.network.security_group_api [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Adding security group 30dd83c2-9e3b-46b9-88dc-829de50a2dee to port d73b582c-8472-4325-800b-b5cb2624c200 May 10 20:19:19.214529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:19.215150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:19.233155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:19.233970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:19.234977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:19.237547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:19.447846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:19.457522 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a831436a-8415-4597-971e-414ee3cccfbf tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1712 microversion: 2.1 time: 0.248694 May 10 20:19:19.478958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 179/347] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:19 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1712 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:19.717103 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:19.721730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:19.726550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:19.727331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:19.728363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:19.729827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:19.915154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:19.929848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce4077aa-dcd2-472f-9cd9-ac9737e93935 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1505 microversion: 2.1 time: 0.218406 May 10 20:19:19.933625 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 180/348] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:19 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:20.011759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7e32e44c-08dd-4f63-9233-e8db59ee4a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action" status: 202 len: 0 microversion: 2.1 time: 1.056863 May 10 20:19:20.016067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 169/349] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:19:18 2022] POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:19:20.022398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:20.023021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:20.031562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-59bec5a1-f474-4314-a8a0-4669a1291033 req-fb8d9687-0446-484c-b43a-011c272af0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:20.038656 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.038656 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.039846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.041427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.047521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-59bec5a1-f474-4314-a8a0-4669a1291033 req-fb8d9687-0446-484c-b43a-011c272af0c2 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.047980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-59bec5a1-f474-4314-a8a0-4669a1291033 req-fb8d9687-0446-484c-b43a-011c272af0c2 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.099743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-59bec5a1-f474-4314-a8a0-4669a1291033 req-fb8d9687-0446-484c-b43a-011c272af0c2 service nova] Creating event network-changed:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:19:20.106597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-59bec5a1-f474-4314-a8a0-4669a1291033 req-fb8d9687-0446-484c-b43a-011c272af0c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080598 May 10 20:19:20.112051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 170/350] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:20.177890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:20.186018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:20.209888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.210382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.211181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.211619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.304640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:20.320247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a5339e0d-352c-4322-b398-ef720a0ad9ef tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1759 microversion: 2.1 time: 0.302211 May 10 20:19:20.321386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 181/351] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:20 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1759 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:20.595868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:20.604055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:20.610008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:20.616982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d65e342d-8e32-498e-9b39-fc40561713b7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.443267 May 10 20:19:20.619450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 171/352] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:20 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:20.950252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:20.950372 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:20.959227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.959849 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:20.960945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:20.961615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:21.253011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:21.269748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ecfd7ca7-9602-41e1-b347-a6c254a937bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1505 microversion: 2.1 time: 0.324634 May 10 20:19:21.269748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 182/353] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:20 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:21.643355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:21.644367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:21.650387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:21.650912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:21.651758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:21.652837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:21.796992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:21.804935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:21.806647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:21.807957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-90efadf7-76ad-4104-89c1-dbbed76d0667 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.173304 May 10 20:19:21.809100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 172/354] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:21 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:22.126577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-5b58b934-57a6-495d-b913-987747f8eefd req-5f630706-885f-410e-ad1d-a4186d1297a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76633cc-cfa9-4b73-b4d7-ca9d412144d0", "name": "network-vif-deleted", "tag": "6af8c166-5d5a-49fc-8b05-cfa52d164e50"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:22.136016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5b58b934-57a6-495d-b913-987747f8eefd req-5f630706-885f-410e-ad1d-a4186d1297a2 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:22.137255 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5b58b934-57a6-495d-b913-987747f8eefd req-5f630706-885f-410e-ad1d-a4186d1297a2 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:22.149691 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-5b58b934-57a6-495d-b913-987747f8eefd req-5f630706-885f-410e-ad1d-a4186d1297a2 service nova] Creating event network-vif-deleted:6af8c166-5d5a-49fc-8b05-cfa52d164e50 for instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 on hv-cinder-82880 May 10 20:19:22.154587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-5b58b934-57a6-495d-b913-987747f8eefd req-5f630706-885f-410e-ad1d-a4186d1297a2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 May 10 20:19:22.159487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 183/355] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:22.285829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:22.286904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:22.296952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:22.297657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:22.298569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:22.301081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:22.382540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:22.391237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d38a248-9da3-43c8-9636-5c17567a094c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1299 microversion: 2.1 time: 0.109089 May 10 20:19:22.393132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 173/356] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:22 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:22.831212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:22.832682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:22.845734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:22.846458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:22.847552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:22.849365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:23.170166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:23.206883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:23.212792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:23.215825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e4120949-6ee9-4ba6-a089-9ca465053ddc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.392754 May 10 20:19:23.223119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 184/357] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:22 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:23.410957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:23.412306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:23.420979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:23.421757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:23.425944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:23.427122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:23.526276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:23.526979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:23.532102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lazy-loading 'fault' on Instance uuid c76633cc-cfa9-4b73-b4d7-ca9d412144d0 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:19:23.639387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:23.647896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fad4cf6c-cd52-44c6-a201-bcbdef029168 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 200 len: 1304 microversion: 2.1 time: 0.241599 May 10 20:19:23.659899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 174/358] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:23 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:24.240991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:24.242558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:24.256984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:24.257681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:24.258649 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:24.260559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:24.666814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:24.667354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: c76633cc-cfa9-4b73-b4d7-ca9d412144d0] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:24.674447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:24.675309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:24.676482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:24.677546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:24.701472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] HTTP exception thrown: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Request method failure captured: May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 HTTP/1.1 May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesilol5v-Gc6HwyK1ZPBHYqO96c7O8iQJcdQBl77l8wVYplpniMOUIIGzoNjk3RVDDLjUOJhbexJVmmTkj3SHwo2bW98mvoG7WSAYclGiobRRHexeAYEJ-UCRi7WvtfJEKf6p73bys9WRNC9-1d1FAKSwelakhGtgnHXcCMNl7JEixI May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 752cb97b116941b7bc7ef28b2e796b1f May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesActionsTest-406000363 May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:19:24.704061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_752cb97b116941b7bc7ef28b2e796b1f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesActionsTest-406000363 May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 752cb97b116941b7bc7ef28b2e796b1f May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesActionsTest-406000363 May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesActionsTest-406000363-project May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: e98e849891bf45768936056e3206d880 May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesActionsTest-406000363-project May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. May 10 20:19:24.705820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'c76633cc-cfa9-4b73-b4d7-ca9d412144d0'} May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:19:24.712969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. May 10 20:19:24.714237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:19:24.716660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Returning 404 to user: Instance c76633cc-cfa9-4b73-b4d7-ca9d412144d0 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:19:24.716660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b138a6df-a71d-4781-81e8-09353a84df2e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0" status: 404 len: 111 microversion: 2.1 time: 0.045189 May 10 20:19:24.716660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 175/359] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:24 2022] GET /compute/v2.1/servers/c76633cc-cfa9-4b73-b4d7-ca9d412144d0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:19:24.903208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:24.904983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-811087532", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "networks": [{"uuid": "3bb2c490-f5c2-46ac-b9c0-c30485604258"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:24.922870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:24.926748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:24.926748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6ad92675-153e-45c7-b12e-1526ec85de73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.689024 May 10 20:19:24.941219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 185/360] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:24 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:25.000285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] validate_networks() for [('3bb2c490-f5c2-46ac-b9c0-c30485604258', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:19:25.534248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:19:25.535518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:19:25.537105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:19:25.538047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:19:25.539955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:19:25.551664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:25.552341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:25.553317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:25.553743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:25.573472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Getting quotas for project 752cb97b116941b7bc7ef28b2e796b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:19:25.578171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Getting quotas for user e98e849891bf45768936056e3206d880 and project 752cb97b116941b7bc7ef28b2e796b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:19:25.617620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:19:25.622548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:19:25.837851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c4ac685-9044-4b59-8d8d-ed420547da51 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941222 May 10 20:19:25.852954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e44cffe4-fb7c-4a6e-b52c-a6165171237e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:25.854284 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e44cffe4-fb7c-4a6e-b52c-a6165171237e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:25.862340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 176/361] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:19:25.956473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:25.957085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:25.969420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e44cffe4-fb7c-4a6e-b52c-a6165171237e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:25.977716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:25.978191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:25.978978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:25.979437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:25.986670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e44cffe4-fb7c-4a6e-b52c-a6165171237e tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1213 microversion: 2.1 time: 0.133785 May 10 20:19:26.004328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 186/362] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:25 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:26.651448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:26.660034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:26.661564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:26.804758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4ec14904-6205-4755-93a0-d74aa07c19fd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.710270 May 10 20:19:26.804758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 177/363] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:25 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:27.012212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8133f9e0-51a0-45c0-b44a-a7bf3e156378 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:27.012918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8133f9e0-51a0-45c0-b44a-a7bf3e156378 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:27.068876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8133f9e0-51a0-45c0-b44a-a7bf3e156378 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:27.075618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8133f9e0-51a0-45c0-b44a-a7bf3e156378 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1213 microversion: 2.1 time: 0.067874 May 10 20:19:27.076197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 187/364] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:27 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:27.686756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:27.688597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:27.723645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:27.726931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:27.730357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:27.731106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:28.019618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:28.029589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:28.031473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:28.038471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ef26d0b5-6679-4fa5-ae4d-91b7a318995c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.355715 May 10 20:19:28.039776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 178/365] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:27 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:28.092860 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:28.095131 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:28.102487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:28.103355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:28.104420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:28.105529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:28.212227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:28.224512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-90df0205-1d83-4581-b555-8aeb28decb54 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1217 microversion: 2.1 time: 0.135444 May 10 20:19:28.225331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 188/366] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:28 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:28.485166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1839317043", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2092652250", "security_groups": [{"name": "tempest-secgroup-smoke-1305304647"}], "networks": [{"uuid": "339c6d8e-af10-4b8c-9702-0522fc8af9c1"}], "block_device_mapping_v2": [{"uuid": "bfd282ab-ce44-490b-bfcb-67546d6b3c57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:28.752719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] validate_networks() for [('339c6d8e-af10-4b8c-9702-0522fc8af9c1', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:19:29.057506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:29.068201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:29.068201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.068201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.068201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.068709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.312171 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:29.324674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:29.328407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:29.329627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-01d46ad3-d3e5-48b4-a9c9-5378d65114a2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1741 microversion: 2.20 time: 0.276546 May 10 20:19:29.333507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 189/367] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:29 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:29.338014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:29.338662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:29.353682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.354168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.354963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.355411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.466600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:29.494878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:19:29.498779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:19:29.498779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:19:29.498779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:19:29.498779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:19:29.500791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-814fc5a6-4459-42e4-81fc-da1829ebc8f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1273 microversion: 2.1 time: 0.157202 May 10 20:19:29.501459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 190/368] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:29 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:29.523829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.524334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.525154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:29.525592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:29.558505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Getting quotas for project b9724c9a575141d48bbfbde685774622. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:19:29.563405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Getting quotas for user f213f79341ab4462b3d51352ccb9de2c and project b9724c9a575141d48bbfbde685774622. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:19:29.628283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:19:29.630396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfd282ab-ce44-490b-bfcb-67546d6b3c57',volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:19:30.229831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-60b78ba3-16cd-43f4-bf35-5e55512d8fb3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.750467 May 10 20:19:30.231315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 179/369] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:19:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 20:19:30.241410 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8ac5edae-7f6a-4f11-b445-3a99572b39e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:30.242021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8ac5edae-7f6a-4f11-b445-3a99572b39e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:30.347919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:30.349339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:30.351552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8ac5edae-7f6a-4f11-b445-3a99572b39e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:30.359347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:30.359530 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8ac5edae-7f6a-4f11-b445-3a99572b39e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1089 microversion: 2.1 time: 0.121903 May 10 20:19:30.360012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 191/370] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:30 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1089 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:30.361508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:30.362492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:30.363024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:30.525064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:30.525064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:30.534697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:30.535157 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:30.535946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:30.536373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:30.698525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:30.734596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:30.736403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:30.737615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e91063ca-720a-47e3-8615-a7f3034f91cf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1723 microversion: 2.20 time: 0.394984 May 10 20:19:30.738199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 180/371] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:30 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:30.859953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:30.876073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e251df01-97f7-43ec-8fa5-faaeff06dc59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.362194 May 10 20:19:30.885894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 192/372] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:30 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:31.376624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c93a8f1-9cbe-43fc-a36a-336c9e4b50c2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:31.377352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c93a8f1-9cbe-43fc-a36a-336c9e4b50c2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:31.462591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2c93a8f1-9cbe-43fc-a36a-336c9e4b50c2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:31.477447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c93a8f1-9cbe-43fc-a36a-336c9e4b50c2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1089 microversion: 2.1 time: 0.105355 May 10 20:19:31.478121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 181/373] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1089 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:31.754936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:31.755727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:31.761926 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:31.763224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:31.764804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:31.765400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:31.893757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:31.896148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:31.916599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:31.928903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:31.928903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:31.928903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:31.963041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:31.971581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:31.982562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:31.985335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-08215050-0249-4e4e-8bab-6838e91e814f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1723 microversion: 2.20 time: 0.234208 May 10 20:19:31.991944 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 193/374] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:31 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:32.092857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-8d4dc0e1-fad4-42ed-b9ab-c12d5c6c46fb req-b7f608db-3fa9-4ffe-816c-8a16d8d93e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24b00ee-35b0-4955-99d0-c16edac4f550", "tag": "9c4eb7e4-91b6-4919-b90c-652945fa75f7"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:32.105260 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-8d4dc0e1-fad4-42ed-b9ab-c12d5c6c46fb req-b7f608db-3fa9-4ffe-816c-8a16d8d93e74 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:32.106725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-8d4dc0e1-fad4-42ed-b9ab-c12d5c6c46fb req-b7f608db-3fa9-4ffe-816c-8a16d8d93e74 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:32.121062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-8d4dc0e1-fad4-42ed-b9ab-c12d5c6c46fb req-b7f608db-3fa9-4ffe-816c-8a16d8d93e74 service nova] Creating event network-changed:9c4eb7e4-91b6-4919-b90c-652945fa75f7 for instance d24b00ee-35b0-4955-99d0-c16edac4f550 on hv-cinder-82880 May 10 20:19:32.143291 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-8d4dc0e1-fad4-42ed-b9ab-c12d5c6c46fb req-b7f608db-3fa9-4ffe-816c-8a16d8d93e74 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054810 May 10 20:19:32.145923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 194/375] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:32.150010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:32.161373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1194f152-ac11-4e38-9178-fa814c469c6c tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.270633 May 10 20:19:32.162182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 182/376] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:31 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:32.495846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:32.496750 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:32.516713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:32.516713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:32.516713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:32.521822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:32.641622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:32.650431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-09a164cc-0458-4ad7-b1c4-e465f7bf3c65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1139 microversion: 2.1 time: 0.158658 May 10 20:19:32.651832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 195/377] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:32 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1139 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:33.010431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:33.011047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:33.022074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.023503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.030432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.031195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.190522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:33.191574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:33.195686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:33.201737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:33.204056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:33.206131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-44b8eb83-cd9f-4ae9-831c-e509693543d6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1723 microversion: 2.20 time: 0.200856 May 10 20:19:33.207370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 183/378] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:33 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:33.213963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.218256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.219277 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.221101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.570588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:33.592759 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3c8e14ea-8ca5-4e53-8cea-5552f50f00b7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.417198 May 10 20:19:33.594263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 196/379] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:33 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:33.669586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:33.670536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:33.697683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.699640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.719487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:33.719487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:33.996802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:34.007114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aec072ab-04fa-4d4b-89e0-fb98b92b3a77 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1131 microversion: 2.1 time: 0.342803 May 10 20:19:34.017128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 184/380] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1131 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:34.224295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:34.224914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:34.237472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:34.237472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:34.237472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:34.237472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:34.570315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-cacb2ddc-f7c6-499b-bc65-736d62082104 req-d2c2ddc4-b544-4923-a742-6f02012db488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:34.592301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-cacb2ddc-f7c6-499b-bc65-736d62082104 req-d2c2ddc4-b544-4923-a742-6f02012db488 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:34.592301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-cacb2ddc-f7c6-499b-bc65-736d62082104 req-d2c2ddc4-b544-4923-a742-6f02012db488 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:34.620758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-cacb2ddc-f7c6-499b-bc65-736d62082104 req-d2c2ddc4-b544-4923-a742-6f02012db488 service nova] Creating event network-vif-unplugged:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:19:34.630422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-cacb2ddc-f7c6-499b-bc65-736d62082104 req-d2c2ddc4-b544-4923-a742-6f02012db488 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065332 May 10 20:19:34.638762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 185/381] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:34.681520 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:34.683182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:34.702173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:34.705231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:34.707697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:34.716588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:35.047909 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:35.057398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:35.060046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:35.061320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9373aacc-af70-4a0d-9a2e-4672927072c4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1726 microversion: 2.20 time: 0.841214 May 10 20:19:35.062256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 197/382] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:34 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1726 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:35.067022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:35.067988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:35.075693 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:35.076397 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:35.077373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:35.077977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:35.112780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:35.120896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2b2fd20e-c475-4b3f-828d-0aa64742b4f6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.480527 May 10 20:19:35.121500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 186/383] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:34 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:35.128178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4325e36c-1fcc-4911-8314-e2ed4b56816a"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:35.129524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:35.136307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:35.137006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:35.138264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:35.138904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:35.238218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:35.267928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-571d41e1-25ea-4982-bb5f-15eaa09e3d82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1195 microversion: 2.1 time: 0.204417 May 10 20:19:35.282907 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 198/384] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1195 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:36.141041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:36.141990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:36.155622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.158536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.162125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.163560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.387150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e29c4736-d6cc-4f28-9156-ffcc96cc14d7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.263788 May 10 20:19:36.400206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 187/385] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 10 20:19:35 2022] POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 188 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:19:36.421153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:36.430658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:36.439224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:36.448898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4d988997-3ba6-4617-a2d3-cb3ca6025274 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.312939 May 10 20:19:36.452293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 199/386] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:36 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:36.457239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.457773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.461298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.461834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.591145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:36.603984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c3c538b-2e5e-42ea-a385-bba0272cc1f4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1205 microversion: 2.1 time: 0.201855 May 10 20:19:36.604573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 188/387] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1205 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:36.632683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:36.633329 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:36.648549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.649381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.649768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.660871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.963424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-20766fff-3a00-404c-a1fb-5e9edd8a5959 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/action" status: 202 len: 0 microversion: 2.20 time: 0.335498 May 10 20:19:36.964652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 200/388] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 20:19:36 2022] POST /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:19:36.974453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:36.975353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:36.988557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.988557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:36.994275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:36.995360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:37.294767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:37.319154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:37.321848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:37.329470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-feb5bf9d-3c52-4cae-9eef-3c8cf897780f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1752 microversion: 2.20 time: 0.356797 May 10 20:19:37.351366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 189/389] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:36 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1752 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:37.468829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:37.469557 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:37.482501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:37.483125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:37.483968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:37.484401 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:37.620747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:37.621359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:37.630960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:37.633188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:37.637047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:37.638460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:37.806211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:37.815341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e54c87a-e8a7-49be-8dc5-9213454483b5 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.351375 May 10 20:19:37.819399 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 201/390] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:37 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:38.110766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:38.130553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ce7e6452-c0fc-4cc4-aa1a-04a52ca6f8dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1273 microversion: 2.1 time: 0.506555 May 10 20:19:38.131582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 190/391] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1273 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:38.351189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:38.351811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:38.370105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:38.370539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:38.371338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:38.371773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:38.835726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:38.836524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:38.855917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:38.858717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:38.859914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:38.862896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:38.912551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:38.924244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:38.948254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:38.952520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-98b3843c-193a-4696-96b3-a50267caac02 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1752 microversion: 2.20 time: 0.605203 May 10 20:19:38.964472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 202/392] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:38 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1752 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:39.148160 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:39.148792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:39.165912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:39.166772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:39.167798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:39.168463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:39.230788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:39.243636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cb3fcff4-f1a9-4418-9563-6de7bbe2cb4f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.411789 May 10 20:19:39.244225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 191/393] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:38 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:39.370169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-d2549430-d2d9-4c88-84ac-be8cf9407550 req-cd59eb03-635d-45fa-bb25-e53dc3a01ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:39.382687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-d2549430-d2d9-4c88-84ac-be8cf9407550 req-cd59eb03-635d-45fa-bb25-e53dc3a01ea7 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:39.385982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-d2549430-d2d9-4c88-84ac-be8cf9407550 req-cd59eb03-635d-45fa-bb25-e53dc3a01ea7 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:39.398263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-d2549430-d2d9-4c88-84ac-be8cf9407550 req-cd59eb03-635d-45fa-bb25-e53dc3a01ea7 service nova] Creating event network-changed:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:19:39.407809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-d2549430-d2d9-4c88-84ac-be8cf9407550 req-cd59eb03-635d-45fa-bb25-e53dc3a01ea7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042322 May 10 20:19:39.412971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 192/394] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:39.451948 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:39.462140 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-35bb37e5-8ebd-4d2f-863e-6a9b373564b3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.317560 May 10 20:19:39.463195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 203/395] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:39.703474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68219021-1554-4238-8bc4-25cf8d1cac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Action: 'create', calling method: .version_select at 0x7f6029100ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-603570155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLTCHj1wAfindVCww5lAeqd/NQkfogJ18l6DVc5Go2TCrSqBtTGGT2SpXhmX8uZkLMvnc57k3tlD7m188J0VvGsvfZI/ADj2SPgZc12LEP0THl0C/Ib3a4Y6mmEucpWdg=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:39.718647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-68219021-1554-4238-8bc4-25cf8d1cac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:19:39.729339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-68219021-1554-4238-8bc4-25cf8d1cac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for user 46916c5b15254c529bc52ecb711fdd76 and project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:19:39.807325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68219021-1554-4238-8bc4-25cf8d1cac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.256002 May 10 20:19:39.810809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 193/396] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:19:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:39.971047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:39.971865 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:39.979480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:39.979934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:39.981229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:39.981688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.119960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:40.130379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:40.132157 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:40.133215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-17493324-65d3-4b7d-9739-90b81d90a069 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1754 microversion: 2.20 time: 0.166338 May 10 20:19:40.133772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 204/397] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:39 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:40.270712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:40.271561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:40.279192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:40.279739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.281185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:40.282030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.479318 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:40.480157 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:40.487784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:40.488406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.489353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:40.489942 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.656956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:40.666931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-53c80e47-0e5e-4961-9748-08108d70a5e6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.191284 May 10 20:19:40.668533 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 205/398] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:40.856747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-274eb2fa-194e-4db0-acbf-bb13ac471bf3 req-4e99faf5-1d58-4234-9b5d-a4e94e643ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24b00ee-35b0-4955-99d0-c16edac4f550", "name": "network-vif-plugged", "status": "completed", "tag": "9c4eb7e4-91b6-4919-b90c-652945fa75f7"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:40.879646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-274eb2fa-194e-4db0-acbf-bb13ac471bf3 req-4e99faf5-1d58-4234-9b5d-a4e94e643ab5 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:40.880614 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-274eb2fa-194e-4db0-acbf-bb13ac471bf3 req-4e99faf5-1d58-4234-9b5d-a4e94e643ab5 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:40.892234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:40.903151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4ce0d187-eb66-464a-9e59-84501eaa94a2 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.645761 May 10 20:19:40.909637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 194/399] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:40 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:40.914218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-274eb2fa-194e-4db0-acbf-bb13ac471bf3 req-4e99faf5-1d58-4234-9b5d-a4e94e643ab5 service nova] Creating event network-vif-plugged:9c4eb7e4-91b6-4919-b90c-652945fa75f7 for instance d24b00ee-35b0-4955-99d0-c16edac4f550 on hv-cinder-82880 May 10 20:19:40.926770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-274eb2fa-194e-4db0-acbf-bb13ac471bf3 req-4e99faf5-1d58-4234-9b5d-a4e94e643ab5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074081 May 10 20:19:40.928235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 206/400] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:41.153633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:41.155787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:41.166299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.167035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:41.168844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.169973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:41.506400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:41.515450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:41.517090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:41.518326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-73353c69-4499-4807-b847-1c3a44121a49 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1754 microversion: 2.20 time: 0.370070 May 10 20:19:41.518891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 195/401] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:41 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1754 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:41.688555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:41.690038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:41.697416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.697903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:41.698713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.699151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:41.845788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:41.853514 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-120ecb19-be90-4a11-bf7d-742a4956c98b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.170662 May 10 20:19:41.854637 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 207/402] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:41.921339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:41.921993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:41.928540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.929345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:41.935797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:41.935797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:42.101021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:42.109399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-22b59958-9a26-4e5a-8c95-7c53d78437fe tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.193069 May 10 20:19:42.110119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 196/403] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:41 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:42.539071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:42.539905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:42.556298 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:42.556752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:42.557534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:42.557970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:42.742680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:42.757813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:42.772810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:42.774598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-42769127-7dad-4028-bddb-bd3cf2a9c790 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.241530 May 10 20:19:42.775578 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 208/404] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:42 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:42.873260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:42.873857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:42.880674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:42.881378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:42.882212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:42.882808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.109279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:43.119467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba9ca791-4b15-4f91-a731-306aa9bd213d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.251347 May 10 20:19:43.127158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:43.127888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:43.130418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 197/405] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:43.135294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.135754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.136547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.136990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.298167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:43.306032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-28c32d62-4d54-4998-8c3a-5b7610a9632f tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1313 microversion: 2.1 time: 0.182602 May 10 20:19:43.306675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 209/406] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:43 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:43.406936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:43.408166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:43.414689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.415174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.416012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.416397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.661800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cbd039d1-7de5-499b-9011-fe0c452338eb tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action" status: 202 len: 0 microversion: 2.1 time: 0.260082 May 10 20:19:43.662732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 198/407] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:19:43 2022] POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:19:43.670887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:43.671510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:43.677626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.678074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.678981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.679415 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.794667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:43.795563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:43.801885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.802369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.803348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:43.803884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:43.847088 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:43.861955 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2d00d1cc-36d4-4ccc-b37e-90be2a4c898d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1751 microversion: 2.1 time: 0.188265 May 10 20:19:43.882911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 210/408] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:43 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:44.113107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:44.121399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:44.123531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:44.124694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-83b8c933-b765-45fc-a620-0a765f57f3ee tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.334540 May 10 20:19:44.125260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 199/409] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:43 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:44.140632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:44.141242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:44.147202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.147580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:44.148356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.148838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:44.300942 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:44.305309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-33aa589f-b002-4b4f-b1fc-1100545ac341 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.168696 May 10 20:19:44.306004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 211/410] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:44.327199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:44.327960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:44.333944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.334432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:44.335213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.335649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:44.549061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:44.558332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7552667a-1822-43b5-9d46-9fc8e784f923 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1497 microversion: 2.1 time: 0.237807 May 10 20:19:44.564966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 200/411] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:44 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:44.903785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:44.904974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:44.911981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.912476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:44.913677 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:44.914151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.077095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:45.086946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aa12389e-f16a-40b0-9b18-44e8a4929088 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1751 microversion: 2.1 time: 0.187093 May 10 20:19:45.087690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 212/412] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:44 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:45.143245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:45.144017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:45.150453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.150902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.151727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.152159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.285777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:45.294018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:45.295588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:45.296746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cca6c08e-fa75-46e8-afe6-3d386e2b26d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.157423 May 10 20:19:45.297307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 201/413] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:45 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:45.322612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:45.323222 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:45.329712 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.330209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.330998 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.331458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.469513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:45.476959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a52a316f-0a5f-4aa0-84f5-716a8f83427a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.158639 May 10 20:19:45.477527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 213/414] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:45.588260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:45.588837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:45.595330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.595858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.597193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.597918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.626858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:19:45.918601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a08e600f-2df8-4e8d-b5b7-af8480612db6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 204 len: 0 microversion: 2.1 time: 0.334446 May 10 20:19:45.919196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 202/415] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:19:45 2022] DELETE /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:19:45.927718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:45.928806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:45.941957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.941957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:45.941957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:45.941957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.077671 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.085050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-953471e1-729f-4927-8c55-6e0a94f2ad4a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.161651 May 10 20:19:46.085617 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 214/416] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:45 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:46.104651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:46.105351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:46.111330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.111803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.112574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.113005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.258962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.267211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-22d48ca2-0489-43ca-b163-1124982d4cb5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.166607 May 10 20:19:46.267825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 203/417] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:46 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:46.315290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:46.315920 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:46.322043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.322538 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.323305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.323740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.452458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.460577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.462062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.463226 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b8939322-1f42-4b76-a881-2a506a94ca39 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.151863 May 10 20:19:46.463785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 215/418] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:46 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:46.494071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:46.494782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:46.501353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.501835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.502639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:46.503078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:46.638276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:46.646110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b515d233-5b09-49ec-bf41-29321e834428 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.155858 May 10 20:19:46.646700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 204/419] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:47.102076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:47.102716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:47.109598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.110052 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.110869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.111303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.248901 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.256222 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f7504a6e-da8c-4f4c-b6c9-55262dd8d0e8 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.158190 May 10 20:19:47.256786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 216/420] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:47 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:47.284577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:47.285191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:47.291413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.291888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.292638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.293073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.458001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.468477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-48c9a706-45b1-4917-a963-eb261cc5dc9f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.187603 May 10 20:19:47.469518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 205/421] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:47 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:47.482777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:47.483666 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:47.489947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.490602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.491379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.492010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.623246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.631939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.633457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.634651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-43634247-e177-42d7-88c7-b66057d0efc0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.157155 May 10 20:19:47.635216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 217/422] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:47 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:47.663805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:47.664419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:47.670464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.670912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.671681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:47.672114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:47.800335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:47.807684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6148e473-6610-4141-a0af-84177364b91c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.147815 May 10 20:19:47.808320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 206/423] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:48.273292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:48.274016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:48.280252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.280706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.281887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.282001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.453302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:48.460857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f51d3d18-fac2-4573-a42c-1619064ec293 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.191979 May 10 20:19:48.461616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 218/424] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:48 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:48.491799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:48.493391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:48.500958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.501413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.502241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.502681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.653701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:48.655187 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:48.663384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.664348 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.665526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.666744 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.696246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:48.706635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d37fc31e-2bea-4561-acb7-882748e1eab4 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.219775 May 10 20:19:48.718900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 207/425] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:48 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:48.825110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:48.826609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:48.845642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.847650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.850699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:48.850825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:48.851740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:48.869858 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:48.871433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:48.872714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b438d143-f174-452c-94bb-97848e393c36 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.223780 May 10 20:19:48.873377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 219/426] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:48 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:49.054812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:49.067686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a5d2ca85-cb0a-48c4-953b-c49ced7d3a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.246518 May 10 20:19:49.068580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 208/427] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:49.482928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:49.483584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:49.492966 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.493426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.494246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.494686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.653351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:49.653351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f5437bab-6ebf-4a73-8953-b8757f8a7ebc tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.174329 May 10 20:19:49.653351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 220/428] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:49 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:49.731182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:49.732175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:49.742770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.743225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.744140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.744581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.891407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:49.892287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:49.902117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:49.902737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.903195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.903971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:49.904631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:49.911787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2fd2bed3-6b07-458e-98df-218fb1983c8a tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.189739 May 10 20:19:49.912613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 209/429] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:49 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:50.052319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:50.063763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:50.065595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:50.067164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4b2ec6b5-e28c-40bf-b0ff-9ce432540dd5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.180117 May 10 20:19:50.068641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 221/430] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:49 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:50.084735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:50.085347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:50.091476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.092526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.093365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.093812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.244153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:50.259878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-271b6433-5e55-418f-9d4a-49d3619c020b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.178803 May 10 20:19:50.260738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 210/431] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:50 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:50.672793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:50.673412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:50.680979 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.686499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.692661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.692661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.812933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-47302f5b-ffde-4764-878c-14237823aa86 req-e7acb7e7-4ac1-42f7-b1a6-653800c847be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "name": "network-vif-plugged", "status": "completed", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:50.826840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-47302f5b-ffde-4764-878c-14237823aa86 req-e7acb7e7-4ac1-42f7-b1a6-653800c847be service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.826840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-47302f5b-ffde-4764-878c-14237823aa86 req-e7acb7e7-4ac1-42f7-b1a6-653800c847be service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.839155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-47302f5b-ffde-4764-878c-14237823aa86 req-e7acb7e7-4ac1-42f7-b1a6-653800c847be service nova] Creating event network-vif-plugged:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:19:50.844980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-47302f5b-ffde-4764-878c-14237823aa86 req-e7acb7e7-4ac1-42f7-b1a6-653800c847be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 May 10 20:19:50.846348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 211/432] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:50.873646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:50.879004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d83692a-137a-48c3-b51a-e4b0fcc6cbb6 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.213430 May 10 20:19:50.880095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 222/433] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:50 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:50.934346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:50.935625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:50.949274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.950550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:50.955878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:50.957882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.088496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:51.089380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:51.101099 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.101843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.102843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.104615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.184517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:51.199978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ba2b86f-e5b1-495b-9954-9a7a29ad4b10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.273708 May 10 20:19:51.202914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 212/434] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:50 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:51.282616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:51.283240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:51.289272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.289735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.290690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.291129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.299946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:51.308909 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:51.311247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:51.312436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4127cac1-fcf3-4dd4-8bc3-87f3b6636ba6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.228997 May 10 20:19:51.313060 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 223/435] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:51 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:51.450823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:51.458824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d87bcd81-cf64-4608-b27e-eb78f62a2ba1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.181767 May 10 20:19:51.460463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 213/436] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:51.898764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:51.899380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:51.905673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.906209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:51.906972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:51.907399 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.054628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.065073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f41b6ee4-6948-44cf-ac27-4c62520564ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.169920 May 10 20:19:52.073519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 224/437] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:51 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:52.220799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:52.221405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:52.228200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.228654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.229437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.229876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.331405 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:52.332020 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:52.341605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.342118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.342929 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.343376 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.397590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.411572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5525cd21-5b7e-4770-b16d-1cb985258f16 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.194607 May 10 20:19:52.420491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 214/438] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:52 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:52.483041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:52.484452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:52.493038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.495659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.496547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:52.499293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:52.525730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.536008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.537633 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.538859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7b4a9688-4587-4580-8dc4-1b84227a27da tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.211494 May 10 20:19:52.539420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 225/439] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:52 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:52.641704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:52.658872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4cb87aef-56ee-4ff9-a52e-52816142513c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.185652 May 10 20:19:52.659499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 215/440] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:53.083564 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.084173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:53.090513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.090961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.093959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.093959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.259405 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.267763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4ec74ddf-29c2-420c-b8a8-9cf593ab7af3 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.188036 May 10 20:19:53.268335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 226/441] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:53.437619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.438910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:53.447376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.448119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.449140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.449787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.559064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.559809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:53.566914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.567523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.568419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.568975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.635791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.644883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc0cfb77-c2b4-4dae-9d85-65aaef2a74e6 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.211436 May 10 20:19:53.645848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 216/442] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:53.681802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.682743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:53.689314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.689832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.690637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:53.691071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:53.733747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.742224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.743737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.745176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f1fe6e8-e8cf-4f57-b2a8-f1d1359eaa33 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.189780 May 10 20:19:53.745935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 227/443] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:53.838247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:53.847634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-651cf0a9-4019-4b32-9925-88c226bd9e25 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.175274 May 10 20:19:53.848373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 217/444] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:54.285356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:54.285941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:54.296855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.296855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.296855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.296855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.458665 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:54.466905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b4080b08-cf13-41d6-818c-988b718265d7 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.185848 May 10 20:19:54.467732 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 228/445] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:54 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:54.662537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:54.663120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:54.669876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.670853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.671638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.672073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.765667 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:54.766720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:54.773185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.773722 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.774667 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.775242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.831593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:54.849532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c2e71d36-299a-4c3b-8b48-a90a3d1db1d1 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.191231 May 10 20:19:54.850462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 218/446] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:54 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:54.865319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:54.865942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:54.871937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.872405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.873181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:54.873718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:54.962128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:54.971984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:54.973579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:54.974941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c7225910-7840-4e09-b634-e67a0d33854a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.213929 May 10 20:19:54.985213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 229/447] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:54 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:55.057429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:55.065309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8ceb48f-9a44-4fba-9da8-7498c7650f23 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.204144 May 10 20:19:55.065887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 219/448] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:55.484945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:55.485495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:55.491417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:55.491893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:55.492665 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:55.493104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:55.642563 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:55.651473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cc0649f3-5576-4d93-87de-c4c301df5c59 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.170963 May 10 20:19:55.652075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 230/449] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:55 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:55.867475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:55.868078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:55.874058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:55.874567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:55.875346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:55.875785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:55.997460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:55.997995 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:56.005551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.006305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.007277 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.007727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.033495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.043822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e6b4995e-7639-45f1-b2f9-0cacd05c4003 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.180379 May 10 20:19:56.044422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 220/450] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:55 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:56.082117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:56.082738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:56.088539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.088990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.089766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.090246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.172272 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.181723 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.183674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.185162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-74bffc90-a964-4287-8364-f87ede953a0e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.191512 May 10 20:19:56.202699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 231/451] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:55 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:56.253987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.262517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab297cdf-9769-4962-bb77-cc57f3a7eb26 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.184097 May 10 20:19:56.263114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 221/452] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:56.668806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:56.669413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:56.675715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.676167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.676952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:56.677391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:56.815369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:56.823797 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6ea5ff34-656b-4649-b8b4-227bddcd17af tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.158833 May 10 20:19:56.824707 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 232/453] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:56 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:57.061830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:57.062646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:57.070609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.071569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.072950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.073499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.205435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:57.206041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:57.212702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.213147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.213945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.225275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.288636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.301740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5fe379be-38ff-495e-a737-2c7c1c05f6ca tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.243582 May 10 20:19:57.302753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 222/454] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:57 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:57.307836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:57.308767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:57.315636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.316415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.317431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.318127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.446233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.458253 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.462648 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.464811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-00bf44f3-839e-4c56-97d4-6dcb0b2a07a6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.263137 May 10 20:19:57.470419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 233/455] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:57 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:57.498663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.507557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e8d6dd0-65b2-4f77-972c-818931a5c6b7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.203502 May 10 20:19:57.508626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 223/456] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:57.840711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:57.841331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:57.847741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.848194 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.848957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:57.849391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:57.976542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:57.985176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d8bdeac-ef10-49d5-9183-df59b2bd979a tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.148289 May 10 20:19:57.987199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 234/457] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:57 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:58.319217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:58.319836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:58.326508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.327460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.328231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.328667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.471129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:58.480677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-959c2a93-57e3-47f3-a6a8-f8f302837700 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.163599 May 10 20:19:58.480677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 224/458] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:58 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:58.485354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:58.485962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:58.492145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.492585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.493346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.493784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.524604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:58.525326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:58.532822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.533349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.534222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:58.534721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:58.627385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:58.635769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:58.637397 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:58.638687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-89c2b8c5-8287-4bff-ae48-d2be0d19ae88 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.158096 May 10 20:19:58.639339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 235/459] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:58 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:19:58.669764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:58.677764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-98fd26f7-2aa3-4be9-87b6-d98fe0555a82 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.156866 May 10 20:19:58.678349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 225/460] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:59.001813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:59.002381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:59.009588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.010037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.010844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.011281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.373151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.381201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d10288df-c9a0-4586-8e34-9616de8e8353 tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1503 microversion: 2.1 time: 0.383318 May 10 20:19:59.381781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 236/461] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:58 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:59.496660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:59.497282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:59.505557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.506008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.506857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.507295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.619479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-ae2eb975-b77b-4aa7-8832-930dd6179168 req-950f42ae-c8d1-4990-8a36-8912ebba6841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24b00ee-35b0-4955-99d0-c16edac4f550", "name": "network-vif-deleted", "tag": "9c4eb7e4-91b6-4919-b90c-652945fa75f7"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:59.628102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ae2eb975-b77b-4aa7-8832-930dd6179168 req-950f42ae-c8d1-4990-8a36-8912ebba6841 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.628548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ae2eb975-b77b-4aa7-8832-930dd6179168 req-950f42ae-c8d1-4990-8a36-8912ebba6841 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.640149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-ae2eb975-b77b-4aa7-8832-930dd6179168 req-950f42ae-c8d1-4990-8a36-8912ebba6841 service nova] Creating event network-vif-deleted:9c4eb7e4-91b6-4919-b90c-652945fa75f7 for instance d24b00ee-35b0-4955-99d0-c16edac4f550 on hv-cinder-82880 May 10 20:19:59.645307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-ae2eb975-b77b-4aa7-8832-930dd6179168 req-950f42ae-c8d1-4990-8a36-8912ebba6841 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029390 May 10 20:19:59.649203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 237/462] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:19:59.657541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:59.658283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:59.664380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.664843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.665619 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.666061 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.694602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.703646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-625c933e-ef61-490a-ae4d-330f072b145f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.210746 May 10 20:19:59.704239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 226/463] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:59 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:59.708992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:59.709607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:19:59.715389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.715840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.716616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:19:59.717054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:19:59.809923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.819391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.821260 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.822594 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d3045046-0742-40ef-a783-57de650f7560 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.169827 May 10 20:19:59.823246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 238/464] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:19:59 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:19:59.895324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:19:59.902445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e09bc27c-ca5d-421a-910d-5368a91762c3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.197108 May 10 20:19:59.903019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 227/465] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:19:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:00.399366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:00.399978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:00.405844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.406330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.407093 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.407526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.437803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.438286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.438737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lazy-loading 'fault' on Instance uuid d24b00ee-35b0-4955-99d0-c16edac4f550 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:20:00.480402 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98e849891bf45768936056e3206d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752cb97b116941b7bc7ef28b2e796b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:00.488748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f708ac90-2f01-4342-9236-2da20a3302ac tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 200 len: 1303 microversion: 2.1 time: 0.093182 May 10 20:20:00.489513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 239/466] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:00 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:00.720386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:00.721000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:00.727346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.727790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.728557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.728993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.841279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:00.841893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:00.848779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.849232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.850002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.850472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.872343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:00.880656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6fee757f-6219-47d6-a056-3699f7d03a9d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.164162 May 10 20:20:00.881237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 228/467] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:00 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:00.919999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:00.920728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:00.926653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.927192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.928111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:00.928622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:00.978142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:00.986330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:00.987874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:00.989026 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d4ab59cf-88a1-43c4-a941-976377eb02ef tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.151633 May 10 20:20:00.989590 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 240/468] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:00 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:01.057076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:01.064397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b8b4c2d-3fe1-41a4-9e20-67a0169eb017 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1261 microversion: 2.1 time: 0.148332 May 10 20:20:01.064998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 229/469] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:01.511902 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:01.512516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] [instance: d24b00ee-35b0-4955-99d0-c16edac4f550] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:01.519490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:01.519942 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:01.520714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:01.521154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:01.537524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] HTTP exception thrown: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Request method failure captured: May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 HTTP/1.1 May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesilol5v-Gc6HwyK1ZPBHYqO96c7O8iQJcdQBl77l8wVYplpniMOUIIGzoNjk3RVDDLjUOJhbexJVmmTkj3SHwo2bW98mvoG7WSAYclGiobRRHexeAYEJ-UCRi7WvtfJEKf6p73bys9WRNC9-1d1FAKSwelakhGtgnHXcCMNl7JEixI May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 752cb97b116941b7bc7ef28b2e796b1f May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesActionsTest-406000363 May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:20:01.539069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/752cb97b116941b7bc7ef28b2e796b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_752cb97b116941b7bc7ef28b2e796b1f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesActionsTest-406000363 May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 752cb97b116941b7bc7ef28b2e796b1f May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesActionsTest-406000363 May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesActionsTest-406000363-project May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: e98e849891bf45768936056e3206d880 May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesActionsTest-406000363-project May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. May 10 20:20:01.540659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': 'd24b00ee-35b0-4955-99d0-c16edac4f550'} May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:01.543698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. May 10 20:20:01.544930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:20:01.546010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] Returning 404 to user: Instance d24b00ee-35b0-4955-99d0-c16edac4f550 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:01.546010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4dd3841d-d0cd-4fc1-88b2-48b35ffb76bf tempest-VolumesActionsTest-406000363 tempest-VolumesActionsTest-406000363-project] 10.222.0.65 "GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550" status: 404 len: 111 microversion: 2.1 time: 0.032569 May 10 20:20:01.546010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 241/470] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:01 2022] GET /compute/v2.1/servers/d24b00ee-35b0-4955-99d0-c16edac4f550 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:20:01.898030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:01.898695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:01.904919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:01.905362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:01.906150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:01.906633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.006747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:02.007364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:02.013951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.014480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.015274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.015713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.161205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.170440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.172954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.175001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-53bfe2f5-42ba-472b-bcbd-151820364f11 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.171987 May 10 20:20:02.176197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 242/471] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:02 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:02.196732 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:02.198391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:02.211706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.211706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.211706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.211706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.313325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.322457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ce7949a-417e-4bb7-9465-dd293e5ba85e tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.428409 May 10 20:20:02.323179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 230/472] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:01 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:02.352085 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.360789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-07aeeb5b-1244-44be-bf88-ad7cbd2b2b01 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1445 microversion: 2.1 time: 0.182699 May 10 20:20:02.360789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 243/473] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1445 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:02.377214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:02.377833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:02.383923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.384384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.385150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:02.385588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:02.515228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:02.522515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fe94570d-8e90-4463-b135-6cc0a5690251 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1445 microversion: 2.1 time: 0.149153 May 10 20:20:02.523250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 231/474] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:03.193322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:03.193961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:03.200733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:03.201178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:03.206117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:03.206117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:03.338295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:03.339721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:03.340333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:03.346919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:03.347089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:03.347399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:03.348240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:03.348548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:03.348674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:03.349793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5f17d992-657b-45cb-8335-0d7f86f15071 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.160481 May 10 20:20:03.352030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 244/475] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:03 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:03.559703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:03.569302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-122ac06f-4ae7-4aeb-88af-bacf7e1a35dc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.233312 May 10 20:20:03.570131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 232/476] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:03 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:04.392104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:04.392104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:04.392104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:04.392104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:04.392980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:04.392980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:04.513186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:04.521589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:04.523105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:04.524264 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-985363e4-7d5e-4837-beba-909897fa4ff5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.159443 May 10 20:20:04.524850 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 245/477] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:04 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:04.586880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:04.587792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:04.594786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:04.595230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:04.598648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:04.598648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:04.759363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:04.767262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ead66c67-becd-431a-a1be-f483ba1c27bc tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.184309 May 10 20:20:04.767837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 233/478] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:04 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:05.543677 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:05.544510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:05.551755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:05.552301 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:05.553320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:05.553830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:05.673027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-2b410bfb-5828-403e-a48b-19b66e302e6f req-ce909065-22a9-4734-ac9c-4459ecf37af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:05.681518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2b410bfb-5828-403e-a48b-19b66e302e6f req-ce909065-22a9-4734-ac9c-4459ecf37af0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:05.681957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2b410bfb-5828-403e-a48b-19b66e302e6f req-ce909065-22a9-4734-ac9c-4459ecf37af0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:05.693115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-2b410bfb-5828-403e-a48b-19b66e302e6f req-ce909065-22a9-4734-ac9c-4459ecf37af0 service nova] Creating event network-changed:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:20:05.698765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-2b410bfb-5828-403e-a48b-19b66e302e6f req-ce909065-22a9-4734-ac9c-4459ecf37af0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 May 10 20:20:05.699654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 234/479] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:20:05.701397 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:05.710582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:05.717059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:05.717059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5cf96d51-775d-4eb9-bd82-4f5de93cb50a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.174066 May 10 20:20:05.717059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 246/480] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:05 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:05.785483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:05.786214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:05.792574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:05.793024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:05.793841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:05.794254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:05.935739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:05.943598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9462ef57-6a39-4897-903f-9435b81b0b46 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.163211 May 10 20:20:05.944180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 235/481] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:05 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:06.731873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:06.732398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:06.739369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:06.739824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:06.740596 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:06.741038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:06.872439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:06.881417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:06.883028 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:06.884228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e5ff4454-d21c-42e6-b662-fc58e8215943 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.156369 May 10 20:20:06.884798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 247/482] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:06 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:06.961035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:06.961642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:06.967986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:06.968428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:06.969185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:06.969623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:07.110860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:07.118571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-029d751f-ea8c-4be9-8c83-6d44d4ed82c0 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.161293 May 10 20:20:07.119121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 236/483] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:06 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:07.209304 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "276bb01e-3b65-4292-b8ce-691e3e0b66ff"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:07.210487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:07.216385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:07.216842 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:07.217615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:07.218057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:07.902753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:07.903362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:07.909184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:07.909633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:07.910438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:07.910871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:08.035580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:08.043676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:08.045170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:08.046853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a287c791-de8f-4d6c-96e7-d1e38e9288e9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.147484 May 10 20:20:08.047420 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 237/484] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:07 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:08.135885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:08.142241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:08.142552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:08.142843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:08.143676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:08.144113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:08.286513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:08.294421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d0281ddd-a76e-480f-b1d7-af893213125f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1756 microversion: 2.1 time: 0.162340 May 10 20:20:08.295001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 238/485] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:08 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:09.080612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:09.080612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:09.090375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:09.104880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:09.110684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:09.111737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:09.538370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:09.552476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:09.554597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:09.556463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ecf5326f-c6d9-4fe3-b13a-0c7476507155 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.495275 May 10 20:20:09.557931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 239/486] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:09 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:09.566032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:09.566671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:09.579825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:09.580572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:09.581532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:09.582150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:09.832561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-77213304-c99d-4f6d-b02a-625618b722f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.626792 May 10 20:20:09.833185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 248/487] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:20:07 2022] POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments => generated 194 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:09.838364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:09.843275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eabad690-5a81-464d-a014-a67ee3f945f9 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1759 microversion: 2.1 time: 0.284095 May 10 20:20:09.843864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 240/488] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:09 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1759 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:09.857074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1726688796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-603570155", "security_groups": [{"name": "tempest-secgroup-smoke-823694651"}], "block_device_mapping_v2": [{"uuid": "2ea987fb-020b-46eb-852e-d4301ebd3e69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5faeb9f8-90a5-4864-8255-be306f147ea8"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:10.041390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] validate_networks() for [('5faeb9f8-90a5-4864-8255-be306f147ea8', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:20:10.514414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:20:10.514414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:20:10.514414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:20:10.514964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:20:10.515448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:20:10.524829 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:10.525652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:10.526846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:10.527523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:10.547033 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:20:10.551587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for user 46916c5b15254c529bc52ecb711fdd76 and project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:20:10.577468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:10.587415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:10.595698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:10.596149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:10.597050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:10.597492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:10.685319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:20:10.687724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea987fb-020b-46eb-852e-d4301ebd3e69',volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:20:10.831007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:10.844359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:10.848884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:10.850124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0e84a2d2-2ee8-473e-92a4-c42adf62a100 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.276903 May 10 20:20:10.854205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 241/489] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:10 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:11.194342 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8c82f4e-7057-4649-9b3c-48ee6676726e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.358354 May 10 20:20:11.195767 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 249/490] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:20:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:20:11.206350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-854f3cd6-d598-4425-96a7-bde9a9f00ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:11.207389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-854f3cd6-d598-4425-96a7-bde9a9f00ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:11.276037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-854f3cd6-d598-4425-96a7-bde9a9f00ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:11.285025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-854f3cd6-d598-4425-96a7-bde9a9f00ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1094 microversion: 2.1 time: 0.082095 May 10 20:20:11.294353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 242/491] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:11 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:11.872871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:11.873495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:11.880571 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:11.881024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:11.881891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:11.882274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:12.113396 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:12.132143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:12.139249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:12.141244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7a0ea3ff-ff78-4efa-8874-c9e36da947df tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.272275 May 10 20:20:12.142305 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 250/492] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:11 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:12.302584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5cb6e4aa-a56b-4eb4-84a8-91f9603f4f99 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:12.303196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5cb6e4aa-a56b-4eb4-84a8-91f9603f4f99 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:12.356112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5cb6e4aa-a56b-4eb4-84a8-91f9603f4f99 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:12.363369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5cb6e4aa-a56b-4eb4-84a8-91f9603f4f99 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1094 microversion: 2.1 time: 0.064562 May 10 20:20:12.363936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 243/493] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:12 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:12.876146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-c1ac11ad-d95c-400d-b7e6-32837ea405f3 req-d24d4022-9644-4b78-b236-97e4dc205bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "name": "network-vif-plugged", "status": "completed", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:12.888056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-c1ac11ad-d95c-400d-b7e6-32837ea405f3 req-d24d4022-9644-4b78-b236-97e4dc205bbf service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:12.888488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-c1ac11ad-d95c-400d-b7e6-32837ea405f3 req-d24d4022-9644-4b78-b236-97e4dc205bbf service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:12.920863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-c1ac11ad-d95c-400d-b7e6-32837ea405f3 req-d24d4022-9644-4b78-b236-97e4dc205bbf service nova] Creating event network-vif-plugged:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:20:12.926776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-c1ac11ad-d95c-400d-b7e6-32837ea405f3 req-d24d4022-9644-4b78-b236-97e4dc205bbf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056545 May 10 20:20:12.927945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 251/494] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:13.164048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:13.165697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:13.187024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:13.191727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:13.194102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:13.194679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:13.377807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:13.382374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:13.383241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:13.411446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:13.411446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:13.411446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9ab437b9-146d-49ae-9bee-ee4b67860cdd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.236694 May 10 20:20:13.412467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 244/495] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:13 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:13.412551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:13.412551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:13.412551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:13.412551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:13.495593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:13.499678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-61266b0c-b487-48fe-947b-9a1779fa44b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1136 microversion: 2.1 time: 0.121886 May 10 20:20:13.500915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 252/496] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:13 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1136 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:14.429461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:14.431250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:14.444835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:14.445650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:14.447052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:14.447401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:14.516748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:14.517368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:14.524803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:14.525272 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:14.526058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:14.534826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:14.621939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:14.636499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8e734ab-c614-4f94-864a-91cb4ac78cb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1200 microversion: 2.1 time: 0.123495 May 10 20:20:14.638875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 253/497] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:14 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1200 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:14.696061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:14.709528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:14.711166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:14.712640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-965cbadf-3f6b-4573-b362-03951b24a623 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.288158 May 10 20:20:14.713371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 245/498] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:14 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:15.660046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:15.661576 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:15.667963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:15.668442 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:15.669223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:15.669664 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:15.745931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:15.747817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:15.758944 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:15.762469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:15.763247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:15.764532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:15.766804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:15.771449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6499eb79-7cf2-4e46-b57a-ad4d9e83bdc8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1210 microversion: 2.1 time: 0.121067 May 10 20:20:15.772258 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 254/499] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:15 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:15.915368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:15.924325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:15.925891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:15.927087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b3d05495-3018-4eb7-8130-1610d5027c78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.193279 May 10 20:20:15.928711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 246/500] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:15 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:16.795793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:16.796663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:16.848867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:16.850034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:16.858476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:16.861169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:16.946072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:16.948095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:16.958501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:16.959226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:16.960215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:16.960661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:17.072868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:17.083056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4084c8eb-850d-46d8-9d24-b8c0c6d881dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.297086 May 10 20:20:17.092466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 255/501] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:16 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:17.241120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:17.261335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:17.263417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:17.265915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a5a38e6b-09ce-445f-897a-0a3789a19e48 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.324462 May 10 20:20:17.267843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 247/502] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:16 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:17.655501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-5cc69517-9bff-4643-8038-1d62a9353ed4 req-56f36649-1fa8-4725-b54f-462947c948b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9c1d58-2493-43f6-b011-90a3bac5ac0d", "tag": "f51a35ef-40a9-4291-8e5d-3689f54d025d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:17.666241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5cc69517-9bff-4643-8038-1d62a9353ed4 req-56f36649-1fa8-4725-b54f-462947c948b9 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:17.666657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5cc69517-9bff-4643-8038-1d62a9353ed4 req-56f36649-1fa8-4725-b54f-462947c948b9 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:17.697008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-5cc69517-9bff-4643-8038-1d62a9353ed4 req-56f36649-1fa8-4725-b54f-462947c948b9 service nova] Creating event network-changed:f51a35ef-40a9-4291-8e5d-3689f54d025d for instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d on hv-cinder-82880 May 10 20:20:17.708151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-5cc69517-9bff-4643-8038-1d62a9353ed4 req-56f36649-1fa8-4725-b54f-462947c948b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055059 May 10 20:20:17.708151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 256/503] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:18.100671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:18.101317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:18.108589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:18.109417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:18.110555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:18.111143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:18.259368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:18.267696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-946cc1a0-559f-4448-88c3-341f753c57cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.171451 May 10 20:20:18.279514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 248/504] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:18 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:18.286265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:18.287650 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:18.294308 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:18.295017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:18.295969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:18.296569 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:18.445853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:18.456319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:18.457815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:18.459009 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8b2bf0f2-2cd4-43f9-bed9-cc2a5bad6637 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.178094 May 10 20:20:18.470109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 257/505] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:18 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:19.284392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:19.285038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:19.291813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:19.292247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:19.293009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:19.293438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:19.429624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:19.438704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb700c86-6e0b-46bd-8178-b29e04549345 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.158248 May 10 20:20:19.439936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 249/506] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:19 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:19.482366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:19.483039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:19.493061 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:19.493679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:19.494500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:19.495197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:19.650311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:19.661537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:19.663537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:19.664906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fb6d0f96-4486-41a7-b4f6-23f639fc32f8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.191871 May 10 20:20:19.666039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 258/507] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:19 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:20:20.456812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:20.458216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:20.471172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.471955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.472738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.473348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.684733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:20.685968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:20.694065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.695110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.697426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.697426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.701272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:20.714130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5196857e-e4cd-4c5b-a503-a5710fc8ed4d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.261502 May 10 20:20:20.725146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 250/508] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:20 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:20.823899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:20.824416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:20.854597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.855662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.857029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:20.858343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:20.932444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:20.947456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:20.951352 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:20.952975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-97a6cc3d-4c7b-4ec5-a0a6-1b90698ab950 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1810 microversion: 2.20 time: 0.272446 May 10 20:20:20.956272 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 259/509] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:20 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:21.124490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lazy-loading 'services' on Instance uuid 25f6cc79-11c0-4244-ac21-ac182db7d7cc {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:20:21.746101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:21.752602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:21.755056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:21.755716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:21.756720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:21.757353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:21.773832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd14199e-833d-45a0-a150-83db5389e266 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments/2e38b50c-14e8-4c1d-b365-eb11a5da8088" status: 202 len: 0 microversion: 2.1 time: 0.955125 May 10 20:20:21.775108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 251/510] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:20:20 2022] DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments/2e38b50c-14e8-4c1d-b365-eb11a5da8088 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:20:21.824512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:21.826667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:21.844938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:21.845766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:21.846884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:21.847549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:21.879889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lazy-loading 'flavor' on Instance uuid 072e9288-fad4-458c-bf1b-66246d9d51ca {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:20:22.014454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:22.024258 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-48ed33ab-871f-4f42-be9f-e1a5017a42ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.282119 May 10 20:20:22.026809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 260/511] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:21 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:22.039128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:22.040348 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:22.047813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:22.048696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:22.049623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:22.050003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:22.224579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:22.235030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:22.236780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:22.238235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-38c77cf7-748a-4aae-9dda-7df65dfa5194 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1797 microversion: 2.20 time: 0.211600 May 10 20:20:22.251639 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 261/512] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:20:22 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1797 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:22.258522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b0768811-a0f4-434f-9053-858b05f4f64d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/action" status: 200 len: 32 microversion: 2.1 time: 0.442024 May 10 20:20:22.259161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 252/513] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:20:21 2022] POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:20:22.268611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:22.269158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:22.276428 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:22.276889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:22.277692 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:22.278411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:22.428845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:22.439422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-832eacf6-05f0-426d-90fb-91566f20faf4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.174849 May 10 20:20:22.440021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 262/514] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:22 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:23.045821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:23.046769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:23.067456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:23.068014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:23.068895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:23.073936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:23.239420 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:23.247512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7d19ca05-a2fb-4cfa-a76b-87e5c663cc4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.207878 May 10 20:20:23.257609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 253/515] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:23 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:23.459547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:23.460464 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:23.467491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:23.468041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:23.468896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:23.469940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:23.632497 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:23.641040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d0980d87-5d2a-448b-a88f-4c593368fb08 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.185295 May 10 20:20:23.651616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 263/516] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:23 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:24.269365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:24.270251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:24.279800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:24.280547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:24.281525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:24.282195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:24.437354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:24.445589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5c51e727-cc2c-47e3-8eb8-fb4fc4a7e70a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1277 microversion: 2.1 time: 0.184436 May 10 20:20:24.446187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 254/517] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:24 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:24.659001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:24.659585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:24.666426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:24.666882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:24.667677 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:24.668105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:24.809859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:24.820170 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e825a5c-a7dc-41f5-a0d3-8a13872cf88b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.164877 May 10 20:20:24.820805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 264/518] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:24 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:25.464751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:25.464751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:25.471333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:25.471791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:25.472588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:25.473026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:25.627868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:25.637900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-17c41306-3673-45c2-aaa2-c120a0b07001 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.177853 May 10 20:20:25.638838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 255/519] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:25 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:25.841679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:25.846330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:25.852559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:25.853021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:25.853841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:25.854315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.026805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:26.038706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b795303c-eb61-4b1d-8d45-c15c9201fcc4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.204908 May 10 20:20:26.040234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 265/520] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:25 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:26.217843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d0771ac6-b466-4f79-af0a-e224f41708c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:26.228430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0771ac6-b466-4f79-af0a-e224f41708c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:26.229649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0771ac6-b466-4f79-af0a-e224f41708c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.307880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d0771ac6-b466-4f79-af0a-e224f41708c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Going to try to stop instance {{(pid=117754) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 20:20:26.524651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d0771ac6-b466-4f79-af0a-e224f41708c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.310052 May 10 20:20:26.525649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 256/521] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:20:26 2022] POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:20:26.537695 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:26.547468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:26.560390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:26.561206 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.566364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:26.566925 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.660268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:26.660973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:26.673731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:26.674386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.675440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:26.676071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:26.730037 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:26.739830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f203cb24-d217-43e7-9991-186b5d8d6d16 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.208540 May 10 20:20:26.740427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 266/522] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:26 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:26.819283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:26.827118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab7b7c56-4a1b-4e46-95c6-1d21251fd539 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.172151 May 10 20:20:26.827732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 257/523] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:26 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:27.055921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:27.056546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:27.062807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.063249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.064038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.064471 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.198344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:27.206034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-37e725c1-9e84-4a26-bf86-07a4f6754ac4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.153957 May 10 20:20:27.206632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 267/524] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:27 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:27.764166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:27.764781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:27.771159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.771599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.772418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.772861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.845134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:27.845879 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:27.852441 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.853067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.853847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:27.854339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:27.912174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:27.920564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-101b422a-ebd3-49e8-a333-8413cd3945f3 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.160313 May 10 20:20:27.921231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 258/525] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:27 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:27.990091 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:27.997469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3110b7fe-45c7-45eb-9b30-bbec33ae9638 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.157208 May 10 20:20:27.998044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 268/526] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:27 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:28.223784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:28.224394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:28.230354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:28.230806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:28.231580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:28.232016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:28.362094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:28.369974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-480a1307-0054-4a6a-aa87-2c6025775569 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.150735 May 10 20:20:28.370582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 259/527] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:28 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:28.937696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:28.938328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:28.945338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:28.945893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:28.947601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:28.947822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:29.013876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:29.014533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:29.021059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:29.021514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:29.024139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:29.024139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:29.095053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:29.103120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3bc539ea-6b51-49a5-9f76-7f23bf6f74c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.169209 May 10 20:20:29.103922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 269/528] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:28 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:29.174105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:29.181359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c8f02f4b-5475-42c8-8779-7b586e07d66c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.171269 May 10 20:20:29.181963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 260/529] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:29 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:29.387486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:29.388021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:29.393810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:29.394309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:29.395080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:29.395516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:29.521053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:29.528824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-78d2870b-df24-45c0-8498-ab36e87aeed9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.145549 May 10 20:20:29.529386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 270/530] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:29 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:30.120494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:30.121178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:30.128031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.128482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.129253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.129691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.199068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:30.199807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:30.207444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.207963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.208741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.209169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.265104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:30.274136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-36c48442-09f9-4dd1-8c7a-398b94d47f79 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.157390 May 10 20:20:30.275440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 261/531] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:30 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:30.350546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:30.358167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db304044-5391-40f5-8ff4-e8a8e6d8601a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.163701 May 10 20:20:30.358730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 271/532] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:30 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:30.545901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:30.546558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:30.557238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.557238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.557238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:30.557641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:30.691633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:30.699951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9fd63ed5-eae2-4514-a15d-bd1fa3b1e564 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.158031 May 10 20:20:30.700525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 262/533] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:30 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:31.291549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:31.292144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:31.298732 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.299379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.300148 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.300581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.375211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:31.375839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:31.382109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.382574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.383337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.383776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.469251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:31.477826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8d33052-7d26-4fe3-a233-3843513843bc tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.190016 May 10 20:20:31.478620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 272/534] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:31 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:31.521941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:31.529384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4fac7085-1a73-4a9d-8c15-6df664efd0d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.158051 May 10 20:20:31.544239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 263/535] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:31 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:31.716623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:31.717196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:31.723446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.723922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.724742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:31.725192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:31.854891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:31.862755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0e698bd8-8512-4ce2-b678-bae6c1aeabdd tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.150001 May 10 20:20:31.863328 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 273/536] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:31 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:32.494934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:32.495816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:32.502568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.502765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:32.503618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.504233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:32.560565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:32.561194 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:32.567856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.568301 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:32.569285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.569856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:32.641154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:32.649347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-814a5712-2b7a-4a26-9f37-191a44a8c791 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.158181 May 10 20:20:32.650066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 264/537] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:32 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:32.712493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:32.719895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d80349a7-1759-4824-98cc-229bea3adfe6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.164318 May 10 20:20:32.721146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 274/538] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:32 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:32.880289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:32.880922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:32.886796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.887249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:32.888019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:32.888459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:33.013680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:33.022052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e4af8302-f1cc-475c-9e05-ed11b75a71e0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.145600 May 10 20:20:33.022638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 265/539] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:32 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:33.667125 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:33.667739 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:33.674740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:33.675337 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:33.676012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:33.676447 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:33.741250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:33.741879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:33.748316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:33.748773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:33.749551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:33.749992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:33.810621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:33.818145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-473e7280-e0fd-4e17-97de-de5927417a53 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.154827 May 10 20:20:33.818856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 275/540] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:33 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:34.039994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:34.040610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:34.046756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:34.047265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:34.048051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:34.049092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:34.117020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:34.124404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1545498b-ab16-4a4d-b913-e7a77a6c2566 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.386903 May 10 20:20:34.124917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 266/541] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:33 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:34.181067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:34.189657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e2acb146-0abb-4749-b106-40e11960b40d tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.152962 May 10 20:20:34.190242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 276/542] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:34 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:34.835665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:34.836389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:34.842830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:34.846011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:34.846011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:34.846011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:34.982832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:34.990261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba5088cd-a271-4eb8-9518-1dc609d4da70 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.158533 May 10 20:20:34.990839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 267/543] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:34 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:35.143386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:35.144001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:35.150954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:35.151403 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:35.152181 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:35.152619 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:35.209268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:35.209268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:35.215136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:35.216270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:35.216983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:35.217425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:35.294626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:35.302337 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7c2fb1fa-bed7-46ac-b842-e2a3dd2bc0f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.163412 May 10 20:20:35.306053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 277/544] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:35 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:35.359785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:35.367924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96448401-7d85-468b-8ecd-a94fa0a057a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.164676 May 10 20:20:35.368491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 268/545] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:35 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:36.008297 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:36.008951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:36.014837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.015297 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.016070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.016510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.146562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:36.153968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b55f7d1d-d4f5-4de2-98bf-0c0c5bdb307a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.149711 May 10 20:20:36.154570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 278/546] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:36 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:36.319011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:36.319868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:36.326529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.326987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.327773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.328245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.385366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:36.385980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:36.393371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.394059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.394907 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:36.395346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:36.490738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:36.492679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-beb41290-4687-4d3f-a656-225ed70b0e3a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.177392 May 10 20:20:36.493271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 269/547] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:36 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:36.535518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:36.546844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-329654e9-bd57-4301-9053-07c10ef0af66 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.165478 May 10 20:20:36.551196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 279/548] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:36 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:37.171771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:37.172409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:37.178887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.179336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.180102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.180548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.310481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:37.318789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d837c86-8df9-4e2f-8ec4-364079b69d86 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.150938 May 10 20:20:37.319395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 270/549] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:37 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:37.510027 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:37.510694 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:37.516990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.517439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.518239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.522392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.570671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:37.571311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:37.578215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.578967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.579820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:37.580268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:37.681013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:37.691804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-56913583-ac5d-4189-814a-019175321cfe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.185734 May 10 20:20:37.695325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 280/550] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:37 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:37.763713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:37.773875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a2af67f9-eb28-4ec9-9bd7-ac1b229318a5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.211293 May 10 20:20:37.774499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 271/551] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:37 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:38.336832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:38.337510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:38.343390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.343842 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.344764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.345212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.476986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:38.484758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f9eb3d74-85d6-4da2-bb83-a53dc5ffd5f0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.151888 May 10 20:20:38.485373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 281/552] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:38 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:38.711787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:38.712495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:38.720633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.721222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.721986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.722415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.791666 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:38.792289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:38.799296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.799754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.800544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:38.800986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:38.859664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:38.867566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4448810b-b7a9-43bb-aece-d17e84f13cd1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.159636 May 10 20:20:38.868134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 272/553] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:38 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:38.930219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:38.938768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f2355c51-dd63-4c1c-b47a-91bafd4b8967 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.150932 May 10 20:20:38.939932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 282/554] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:38 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:39.502479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:39.503098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:39.509051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.509513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.510321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.510795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.669126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:39.669126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ec18433-d023-48e9-8fb8-2b23e785a1c4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.158597 May 10 20:20:39.669126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 273/555] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:39 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:39.881510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-4f94f8c1-aafc-4caa-b579-cec872e5f020 req-8dd9ead4-d288-47b2-bb79-29168e369b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c1d58-2493-43f6-b011-90a3bac5ac0d", "name": "network-vif-plugged", "status": "completed", "tag": "f51a35ef-40a9-4291-8e5d-3689f54d025d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:39.887056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:39.888753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:39.890990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-4f94f8c1-aafc-4caa-b579-cec872e5f020 req-8dd9ead4-d288-47b2-bb79-29168e369b7d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.891467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-4f94f8c1-aafc-4caa-b579-cec872e5f020 req-8dd9ead4-d288-47b2-bb79-29168e369b7d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.896463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.896916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.897695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.898186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.903012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-4f94f8c1-aafc-4caa-b579-cec872e5f020 req-8dd9ead4-d288-47b2-bb79-29168e369b7d service nova] Creating event network-vif-plugged:f51a35ef-40a9-4291-8e5d-3689f54d025d for instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d on hv-cinder-82880 May 10 20:20:39.908585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-4f94f8c1-aafc-4caa-b579-cec872e5f020 req-8dd9ead4-d288-47b2-bb79-29168e369b7d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 May 10 20:20:39.909762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 283/556] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:39.959227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:39.959999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:39.966805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.967271 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:39.968077 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:39.968702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:40.067452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:40.077176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-83bc1717-aa8f-4059-be9d-f12d6fc11c6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.196180 May 10 20:20:40.139225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 274/557] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:39 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:40.140024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:40.146389 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cb50b667-2a10-41c3-aa3b-00d427c45b55 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.192016 May 10 20:20:40.146991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 284/558] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:39 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:40.684250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:40.688531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:40.691710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:40.692172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:40.693044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:40.693431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:40.830230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:40.840375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35a67517-1cc6-41ea-84d0-55fba7e7c4d4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.158759 May 10 20:20:40.850401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 275/559] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:40 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:41.144923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:41.145712 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:41.155105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.155560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:41.156383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.156856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:41.164223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:41.164908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:41.172800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.173289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:41.174764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.174764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:41.313096 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:41.326407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-95bd07c0-441e-45b3-a7ff-7a0533ef9934 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1265 microversion: 2.1 time: 0.185714 May 10 20:20:41.326992 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 285/560] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:41 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:41.332946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:41.340922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-67cd68c1-df84-454f-bf82-e0556ac246e9 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.180429 May 10 20:20:41.350383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 276/561] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:41 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:41.857969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:41.858657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:41.865097 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.865541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:41.866325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:41.866756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.000674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:42.009500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-452ecebb-63b2-470a-9b85-cf06ccc6e7c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.155205 May 10 20:20:42.014893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 286/562] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:41 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:42.343459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:42.344049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:42.350870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.354804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.354804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.354804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.358015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:42.358815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:42.365857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.366461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.367246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.367687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.490829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:42.498393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8466def1-6d2a-41a3-82e6-60480a2b283b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1452 microversion: 2.1 time: 0.158661 May 10 20:20:42.498982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 277/563] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:42 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:42.500346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:42.508959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-352bc00d-8886-4523-9309-a47cdc96c674 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.154978 May 10 20:20:42.509947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 287/564] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:42 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:42.515912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:42.516723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:42.524666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.525165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.525954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:42.526513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:42.659181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:42.666675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba1b52ce-b6d6-44b9-8a46-cfbf4b22ae58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1452 microversion: 2.1 time: 0.154869 May 10 20:20:42.667249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 278/565] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:42 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:43.029019 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:43.029664 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:43.035486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:43.036003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:43.036780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:43.037400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:43.178012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:43.185471 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5691249f-930b-4b68-ad95-55a39696bdb8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.160172 May 10 20:20:43.186047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 288/566] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:43 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:43.527354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:43.528362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:43.536999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:43.537413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:43.538226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:43.538668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:43.767943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:43.778563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c13a8448-3f02-425f-ad3a-b1dfd87ee1a2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.255048 May 10 20:20:43.779563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 279/567] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:43 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:44.203201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:44.203868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:44.210818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:44.211777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:44.212558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:44.212997 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:44.349780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:44.357099 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3ea0b80f-db6e-4352-b0ef-012e59ef128b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.157779 May 10 20:20:44.357673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 289/568] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:44 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:44.796780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:44.798104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:44.805325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:44.805780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:44.806599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:44.807039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:44.921136 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-813d34db-777d-4b5b-ba52-7a54e64b4ea1 req-a67483aa-510f-410f-9af2-82750cadfa69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9c1d58-2493-43f6-b011-90a3bac5ac0d", "tag": "f51a35ef-40a9-4291-8e5d-3689f54d025d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:44.930107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-813d34db-777d-4b5b-ba52-7a54e64b4ea1 req-a67483aa-510f-410f-9af2-82750cadfa69 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:44.930592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-813d34db-777d-4b5b-ba52-7a54e64b4ea1 req-a67483aa-510f-410f-9af2-82750cadfa69 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:44.942260 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-813d34db-777d-4b5b-ba52-7a54e64b4ea1 req-a67483aa-510f-410f-9af2-82750cadfa69 service nova] Creating event network-changed:f51a35ef-40a9-4291-8e5d-3689f54d025d for instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d on hv-cinder-82880 May 10 20:20:44.947629 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-813d34db-777d-4b5b-ba52-7a54e64b4ea1 req-a67483aa-510f-410f-9af2-82750cadfa69 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030123 May 10 20:20:44.948738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 290/569] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:44.970270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:44.979644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2a6cb73f-3304-44a9-926a-9058efab8157 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.186640 May 10 20:20:44.980905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 280/570] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:44 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:45.375247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:45.376017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:45.382589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:45.383165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:45.383981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:45.384486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:45.514114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:45.522798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ffb4c4f1-4fb6-47f3-bab1-10f74b8ec5df tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.151859 May 10 20:20:45.523391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 291/571] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:45 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:45.997346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:45.997984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:46.007785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:46.008837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:46.009629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:46.010076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:46.140714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:46.149070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9aab9c28-5167-4b53-9448-9ecce0fe6a9a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.155703 May 10 20:20:46.149635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 281/572] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:45 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:46.540294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.540903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:46.547205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:46.547651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:46.548421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:46.548859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:46.680077 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:46.687555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-575ba6b0-e6f5-4003-a4ba-71d8f859c379 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1676 microversion: 2.1 time: 0.151036 May 10 20:20:46.688149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 292/573] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:47.166281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.166937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:47.173199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:47.173652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:47.174458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:47.174897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:47.305549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:47.313374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1422ebef-63c1-4640-97cd-40aa6f4b3480 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.150919 May 10 20:20:47.313947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 282/574] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:47.713123 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.715059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:47.726986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:47.727422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:47.728208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:47.728651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:47.873871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:47.881772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bd0ced80-e281-4fb6-95e0-38a0fc069298 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1653 microversion: 2.1 time: 0.180571 May 10 20:20:47.882371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 293/575] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1653 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:47.897939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9282d9d0-4ad3-4045-9ae4-d6bf8dd87ca7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:47.903944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9282d9d0-4ad3-4045-9ae4-d6bf8dd87ca7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:47.904394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9282d9d0-4ad3-4045-9ae4-d6bf8dd87ca7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:47.926455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9282d9d0-4ad3-4045-9ae4-d6bf8dd87ca7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Going to try to start instance {{(pid=117754) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 20:20:48.069842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9282d9d0-4ad3-4045-9ae4-d6bf8dd87ca7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.175520 May 10 20:20:48.070487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 283/576] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:20:47 2022] POST /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:20:48.078874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.079844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:48.085283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:48.085742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:48.086547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:48.086986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:48.222704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:48.230290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-154d2622-a5d7-4ca0-8059-271667ec4f8b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1662 microversion: 2.1 time: 0.155072 May 10 20:20:48.230874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 294/577] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:48.331887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.332586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:48.338741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:48.339193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:48.339969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:48.340406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:48.763508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:48.772029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7400cad-7543-4974-87d7-609af623105f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.444819 May 10 20:20:48.772606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 284/578] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:49.246881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:49.247487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:49.254882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:49.255324 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:49.256083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:49.256518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:49.386072 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:49.393848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7d9045d0-d94b-4c38-b7cb-c7acca966709 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1662 microversion: 2.1 time: 0.150868 May 10 20:20:49.394455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 295/579] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:49 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:49.788775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:49.789371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:49.795731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:49.796176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:49.796945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:49.797386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:49.928373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:49.936055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4475d1de-6542-4452-8f75-8f845e287e1e tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.151232 May 10 20:20:49.936624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 285/580] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:49 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:50.415605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:50.416222 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:50.422615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:50.423072 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:50.423914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:50.424357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:50.552265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:50.559552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8bcd5ef-baff-408e-a05b-7b056bc97f80 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1666 microversion: 2.1 time: 0.147902 May 10 20:20:50.560124 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 296/581] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:50 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:50.953287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:50.953888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:50.960331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:50.960791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:50.961568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:50.962007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:51.099671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:51.107544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c211e3d-cc35-41ba-b027-6709543bcb0f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.158087 May 10 20:20:51.108112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 286/582] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:50 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:52.124811 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:52.125662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:52.132888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:52.133341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:52.134250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:52.134686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:52.269987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:52.278381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f6648bdb-e806-4e94-b1bc-0e30878f6294 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.157406 May 10 20:20:52.281320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 297/583] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:52 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:53.295867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:53.296476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:53.302817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:53.303263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:53.304026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:53.304464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:53.432170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:53.440483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ada398a3-4b6c-4963-94cc-9efb129ae8ce tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.148003 May 10 20:20:53.441052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 287/584] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:53 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:54.457198 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:54.457820 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:54.464246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:54.464697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:54.465519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:54.465962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:54.591715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:54.600119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e9ec8f30-af70-4576-adff-9deababc82d5 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.147309 May 10 20:20:54.600715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 298/585] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:54 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:55.616794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:55.617409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:55.623556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:55.624532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:55.624815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:55.625194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:55.772420 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:55.782564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d50f1fc-b640-4968-8735-7c8862164f9f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1733 microversion: 2.1 time: 0.169611 May 10 20:20:55.783145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 288/586] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:55 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:56.800198 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:56.800740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:56.806844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:56.807303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:56.808071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:56.808509 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:56.938077 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:56.946374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-36d15b63-e3f0-4251-8665-4b97e61f387f tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1713 microversion: 2.1 time: 0.150578 May 10 20:20:56.946940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 299/587] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:56 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:57.044071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:57.044563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:57.051429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.051846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.052609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.053049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.129778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] HTTP exception thrown: Cannot 'detach_volume' instance 072e9288-fad4-458c-bf1b-66246d9d51ca while it is in vm_state rescued May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Request method failure captured: May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments/276bb01e-3b65-4292-b8ce-691e3e0b66ff HTTP/1.1 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesguU84PRPrLb4L0FhSaDenHglcTDETqiJr2k5Hq2mgdPBKFLHuiDsxayhPUqrCJdQCRizrald5EKV-eQru44uODOrnFKR5SyQUecbx0zJ49xtuH7XWhJtaHFgdC0Cx7fFjqB43hilR29zEinoUUOGT_5KsBvjmcCEnpc7iXFlyBB3A May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:20:57.131410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d38de3da9e3489ebbbebd4f8aeb0d49", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 261d01f5b22340a09708c71be64edae8 May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:20:57.132969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Cannot 'detach_volume' instance 072e9288-fad4-458c-bf1b-66246d9d51ca while it is in vm_state rescued May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'server_id': '072e9288-fad4-458c-bf1b-66246d9d51ca', 'id': '276bb01e-3b65-4292-b8ce-691e3e0b66ff'} May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:57.133812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 072e9288-fad4-458c-bf1b-66246d9d51ca while it is in vm_state rescued May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 072e9288-fad4-458c-bf1b-66246d9d51ca while it is in vm_state rescued May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:20:57.135325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Returning 409 to user: Cannot 'detach_volume' instance 072e9288-fad4-458c-bf1b-66246d9d51ca while it is in vm_state rescued {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:57.136630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5dacab6e-d598-4776-a8c7-0f25fe0fb1e8 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments/276bb01e-3b65-4292-b8ce-691e3e0b66ff" status: 409 len: 152 microversion: 2.1 time: 0.092739 May 10 20:20:57.136630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 289/588] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:20:57 2022] DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments/276bb01e-3b65-4292-b8ce-691e3e0b66ff => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 20:20:57.141790 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:57.142351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:57.148147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.148588 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.149344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.149774 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.333693 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa090d48-db4e-4d6a-a6ab-fea72ce86b45 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/action" status: 202 len: 0 microversion: 2.1 time: 0.195554 May 10 20:20:57.334302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 300/589] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:20:57 2022] POST /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:20:57.343467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:57.344085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:57.350769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.351012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.351790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:57.352228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:57.485990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:57.493823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-48bb4f8c-2688-482e-b2e9-377ff99361f0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1721 microversion: 2.1 time: 0.154310 May 10 20:20:57.494413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 290/590] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:57 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:58.511843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:58.512540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:58.519172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:58.519625 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:58.520391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:58.520826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:58.645423 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:58.653184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-04bc7d73-ac29-4152-8a60-4a7eecb8f616 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1721 microversion: 2.1 time: 0.145625 May 10 20:20:58.655357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 301/591] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:58 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:59.671110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:59.671731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:20:59.678763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:59.679219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:59.679995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:20:59.680434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:20:59.816463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:20:59.825007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-72a593a7-0b7e-4c9a-9895-4f4bafa10261 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1721 microversion: 2.1 time: 0.157834 May 10 20:20:59.825563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 291/592] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:20:59 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:00.842042 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:00.842602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:00.848866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:00.849311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:00.850071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:00.850524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:00.974595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:00.982292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-97e01af4-ce20-461c-bc99-b318e0ebd936 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1721 microversion: 2.1 time: 0.144119 May 10 20:21:00.982857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 302/593] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:00 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:01.999339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:01.999952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:02.006329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:02.006781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:02.007554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:02.007992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:02.131875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:02.139629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-93f6f139-c68e-4072-b45c-58a4517e6ab2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1727 microversion: 2.1 time: 0.144096 May 10 20:21:02.140189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 292/594] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:01 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:02.156777 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:02.157283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:02.164225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:02.164675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:02.165446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:02.165883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:02.244479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f3949744-3eae-45e1-a880-e24c262c4f7a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091667 May 10 20:21:02.245083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 303/595] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:21:02 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:03.437418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-601fedb8-cc0c-4d2e-8d02-e4be4e5bddd2 req-d1662ec6-66c4-4fea-8bfc-d6c26a60c797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:03.446230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-601fedb8-cc0c-4d2e-8d02-e4be4e5bddd2 req-d1662ec6-66c4-4fea-8bfc-d6c26a60c797 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:03.446684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-601fedb8-cc0c-4d2e-8d02-e4be4e5bddd2 req-d1662ec6-66c4-4fea-8bfc-d6c26a60c797 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:03.458231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-601fedb8-cc0c-4d2e-8d02-e4be4e5bddd2 req-d1662ec6-66c4-4fea-8bfc-d6c26a60c797 service nova] Creating event network-changed:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:21:03.463197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-601fedb8-cc0c-4d2e-8d02-e4be4e5bddd2 req-d1662ec6-66c4-4fea-8bfc-d6c26a60c797 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029435 May 10 20:21:03.463789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 293/596] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:05.477747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a5bf8659-bb49-40ed-9c7f-9e36ecdd0fe6 req-48579dc2-ef4f-42d6-b29e-385498fbf233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:05.486183 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a5bf8659-bb49-40ed-9c7f-9e36ecdd0fe6 req-48579dc2-ef4f-42d6-b29e-385498fbf233 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:05.486634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a5bf8659-bb49-40ed-9c7f-9e36ecdd0fe6 req-48579dc2-ef4f-42d6-b29e-385498fbf233 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:05.497220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a5bf8659-bb49-40ed-9c7f-9e36ecdd0fe6 req-48579dc2-ef4f-42d6-b29e-385498fbf233 service nova] Creating event network-changed:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:21:05.502141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a5bf8659-bb49-40ed-9c7f-9e36ecdd0fe6 req-48579dc2-ef4f-42d6-b29e-385498fbf233 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028512 May 10 20:21:05.502736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 304/597] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:06.652750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1878486472"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:06.662394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:06.662394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:06.662394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:06.662394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:06.662741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:06.790006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.network.security_group_api [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Removing security group 30dd83c2-9e3b-46b9-88dc-829de50a2dee from port d73b582c-8472-4325-800b-b5cb2624c200 May 10 20:21:07.183155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-184015e4-e01c-4a79-b071-546d86eba032 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action" status: 202 len: 0 microversion: 2.1 time: 0.535030 May 10 20:21:07.184017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 294/598] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:21:06 2022] POST /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:21:07.192698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-d849d930-7061-4675-9f69-c2ab76aee7fd req-5a7828c1-38c4-4167-900b-e1617349ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:07.207590 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d849d930-7061-4675-9f69-c2ab76aee7fd req-5a7828c1-38c4-4167-900b-e1617349ba11 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:07.208623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d849d930-7061-4675-9f69-c2ab76aee7fd req-5a7828c1-38c4-4167-900b-e1617349ba11 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:07.236152 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-d849d930-7061-4675-9f69-c2ab76aee7fd req-5a7828c1-38c4-4167-900b-e1617349ba11 service nova] Creating event network-changed:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:21:07.241568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-d849d930-7061-4675-9f69-c2ab76aee7fd req-5a7828c1-38c4-4167-900b-e1617349ba11 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053010 May 10 20:21:07.243286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 305/599] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:08.471159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:08.471923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:08.474114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-b8aec3fe-cfb9-44c0-bf48-b5379987342d req-03511819-084f-4d87-a3e0-a546f8c3f692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:08.479318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:08.479888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:08.480759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:08.481298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:08.482098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b8aec3fe-cfb9-44c0-bf48-b5379987342d req-03511819-084f-4d87-a3e0-a546f8c3f692 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:08.482554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b8aec3fe-cfb9-44c0-bf48-b5379987342d req-03511819-084f-4d87-a3e0-a546f8c3f692 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:08.494795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-b8aec3fe-cfb9-44c0-bf48-b5379987342d req-03511819-084f-4d87-a3e0-a546f8c3f692 service nova] Creating event network-changed:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:21:08.504233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-b8aec3fe-cfb9-44c0-bf48-b5379987342d req-03511819-084f-4d87-a3e0-a546f8c3f692 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030447 May 10 20:21:08.504233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 306/600] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:08.575002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lazy-loading 'services' on Instance uuid e063dab1-512d-48bb-be6f-807abc044f02 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:21:08.759742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-131d878a-072b-466c-9092-dacfe8d87a8c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments/0510b34b-ab38-468a-8c2f-eef335df1815" status: 202 len: 0 microversion: 2.1 time: 0.292312 May 10 20:21:08.760582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 295/601] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:21:08 2022] DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments/0510b34b-ab38-468a-8c2f-eef335df1815 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:21:08.770007 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:08.771063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:08.780425 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:08.784964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:08.784964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:08.784964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:08.816096 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-09a5eacd-3ee9-421b-858a-db22d0dc3c0f tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050859 May 10 20:21:08.817378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 307/602] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:08 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:09.830055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:09.831005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:09.837200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:09.837651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:09.838451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:09.838891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:09.868680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5aeab651-1015-41aa-8e00-87099796e56d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 May 10 20:21:09.869234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 296/603] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:09 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:10.881350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:10.882219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:10.888760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:10.889203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:10.889964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:10.890450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:10.917422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a2573a01-e1bc-457e-be1a-89ba4b4100db tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 May 10 20:21:10.917970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 308/604] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:10 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:11.928914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:11.929758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:11.936032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:11.936483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:11.937252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:11.937689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:11.965819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8f6ce821-0311-4535-a22a-57c3d1ebb569 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040955 May 10 20:21:11.966398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 297/605] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:11 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:12.977168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:12.978105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:12.984300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:12.984744 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:12.985601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:12.986045 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:13.015181 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f82861b0-926b-48a4-b416-d4bcc84308e5 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 May 10 20:21:13.015715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 309/606] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:12 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:14.026674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:14.027634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:14.033950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.034432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.035202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.036253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.063648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30b2fd78-b9fa-4ee0-9763-851d0764ff15 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 May 10 20:21:14.064203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 298/607] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:14 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:14.473779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:14.474338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:14.480567 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.481013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.481776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.482238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.513389 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f65030e2-9f73-491e-84e5-599fd99b05bf tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments/4325e36c-1fcc-4911-8314-e2ed4b56816a" status: 200 len: 194 microversion: 2.20 time: 0.043596 May 10 20:21:14.513965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 310/608] 10.222.0.65 () {60 vars in 1453 bytes} [Tue May 10 20:21:14 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments/4325e36c-1fcc-4911-8314-e2ed4b56816a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:14.573558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:14.574055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:14.580051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.580692 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.581463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.581897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.659305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lazy-loading 'services' on Instance uuid 5ab6f0a6-aa14-407a-b43d-7b7d2855499d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:21:14.827664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a161bec-fd52-4158-a69f-a7bd572ca722 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments/4325e36c-1fcc-4911-8314-e2ed4b56816a" status: 202 len: 0 microversion: 2.20 time: 0.257793 May 10 20:21:14.828392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 299/609] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 10 20:21:14 2022] DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments/4325e36c-1fcc-4911-8314-e2ed4b56816a => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:21:14.836762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:14.837690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:14.843529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.843974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.844726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:14.845153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:14.874493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-32da7416-c1bd-4286-8972-ddd08a2b2103 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041610 May 10 20:21:14.875047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 311/610] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:14 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:15.076023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:15.077036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:15.083592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:15.084045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:15.084816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:15.085257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:15.113516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f72f27e8-ba42-46ab-b76a-a03aa0bc6ff3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 May 10 20:21:15.114061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 300/611] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:15 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:15.890822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:15.891659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:15.899102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:15.899553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:15.900329 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:15.900768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:15.928882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-34451ac5-c066-4c86-9561-0004a7092d3e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043170 May 10 20:21:15.929433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 312/612] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:15 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:16.125477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:16.126418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:16.132968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:16.133414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:16.134202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:16.134639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:16.163813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82c069e0-ac70-4f12-add6-c1f9d7b51a03 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 May 10 20:21:16.164297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 301/613] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:16 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:21:16.940598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:16.941557 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:16.948419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:16.948859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:16.949615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:16.950357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:16.977697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ddb933a5-719c-453a-9be5-e8fd72f42e1f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041070 May 10 20:21:16.978252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 313/614] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:16 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:17.175305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:17.176223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:17.183287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:17.183728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:17.184485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:17.184912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:17.213150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d11dcdfb-6240-4030-81d8-f69cd5bb3d67 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 May 10 20:21:17.213639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 302/615] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:17 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:17.989346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:17.990311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:17.996609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:17.997064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:17.997834 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:17.998310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:18.026865 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d9c0d4f1-4726-4e89-ac9a-d37d35de031e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041538 May 10 20:21:18.027417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 314/616] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:17 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:18.224216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:18.225139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:18.231461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:18.231908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:18.232674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:18.233108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:18.261321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b86ae2c9-ba96-4c2f-b670-e3c445d8313c tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041074 May 10 20:21:18.261808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 303/617] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:18 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:19.038978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:19.039937 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:19.046332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:19.046788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:19.047556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:19.047996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:19.076604 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-06e0c8f4-870d-4ca9-9b82-af813581f15b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042169 May 10 20:21:19.077153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 315/618] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:19 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:19.273348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:19.274316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:19.280584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:19.281167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:19.281930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:19.282402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:19.310218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a60d2108-9799-4e33-8e01-ad7eb7419e10 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 May 10 20:21:19.310702 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 304/619] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:19 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:20.088184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:20.089143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:20.095171 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:20.095626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:20.096401 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:20.096841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:20.124986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-90ee346e-151d-4384-b391-644549ed65b0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040776 May 10 20:21:20.125536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 316/620] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:20 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:21:20.321331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:20.322196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:20.328719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:20.329170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:20.329941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:20.330401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:20.357946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4405270c-e5d1-42e6-a3a7-9fbb3a40696d tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 May 10 20:21:20.358543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 305/621] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:20 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:21.137293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:21.138173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:21.144599 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.145052 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.145823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.146313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.174414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b04dad81-a2a8-4b0a-82f9-1d5d2207f312 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041171 May 10 20:21:21.174962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 317/622] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:21:21 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:21.232726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:21.233218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:21.238988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.239432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.240187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.240750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.264710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:21:21.369438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:21.370540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:21.376391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.376837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.377601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.378147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.406033 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dc6b0717-af0e-40bd-825f-e5f90a5d72d3 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041059 May 10 20:21:21.406555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 318/623] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:21 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 20:21:21.421207 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:21.421697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:21.427526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.427976 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.429280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.429718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.514472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1c90c4f4-b915-4930-8288-6a378f7d9dc9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 204 len: 0 microversion: 2.20 time: 0.285190 May 10 20:21:21.515064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 306/624] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 20:21:21 2022] DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:21:21.528222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:21.528222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:21.531028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.531476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.532255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:21.532690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:21.547202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] HTTP exception thrown: Instance e063dab1-512d-48bb-be6f-807abc044f02 is not attached to volume 0510b34b-ab38-468a-8c2f-eef335df1815 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Request method failure captured: May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments/0510b34b-ab38-468a-8c2f-eef335df1815 HTTP/1.1 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesh7C57XNmyfH0EZ--mu8x-ohxOwdTpnD1PkSB1bEm2EueWcADWq53BOTc93H9TEu4N24Ho1dG3lixcVsAlOb30DIlMg-qcPlMxfHhr7SZN2K9zBWV41t-pFBDT6lT1HsrA0zM5fiCBpWXa_taQtKkEl3O8mOJqDGj_oJkdymDQ6Boo May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: b135986dfe1f499a9655ac3faee4bbbf May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:21:21.571139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b135986dfe1f499a9655ac3faee4bbbf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b135986dfe1f499a9655ac3faee4bbbf May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-TestMinimumBasicScenario-1471470695-project May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 6f5b649235d646fea59e7e61e7e6d8a9 May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-TestMinimumBasicScenario-1471470695-project May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:21:21.572769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance e063dab1-512d-48bb-be6f-807abc044f02 is not attached to volume 0510b34b-ab38-468a-8c2f-eef335df1815 May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'server_id': 'e063dab1-512d-48bb-be6f-807abc044f02', 'id': '0510b34b-ab38-468a-8c2f-eef335df1815'} May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0510b34b-ab38-468a-8c2f-eef335df1815. May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:21:21.573506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e063dab1-512d-48bb-be6f-807abc044f02 is not attached to volume 0510b34b-ab38-468a-8c2f-eef335df1815 May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e063dab1-512d-48bb-be6f-807abc044f02 is not attached to volume 0510b34b-ab38-468a-8c2f-eef335df1815 May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:21.574799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Returning 404 to user: Instance e063dab1-512d-48bb-be6f-807abc044f02 is not attached to volume 0510b34b-ab38-468a-8c2f-eef335df1815 {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:21:21.576690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f0e62c6-a919-4c7f-a0c3-445c51781430 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments/0510b34b-ab38-468a-8c2f-eef335df1815" status: 404 len: 154 microversion: 2.1 time: 0.155329 May 10 20:21:21.576690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 319/625] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:21:21 2022] DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02/os-volume_attachments/0510b34b-ab38-468a-8c2f-eef335df1815 => generated 154 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:21:21.666792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:21.684987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:21.684987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:21.684987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ad7bb9b-9516-4c7e-bad2-b05f9dd72a2b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.157738 May 10 20:21:21.685349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 307/626] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:21 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:21:22.696002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:22.696643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:22.703331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:22.703787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:22.704556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:22.704996 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:22.836544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:22.846045 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:22.846344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:22.847517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8059480f-8f17-41e8-bd48-10f5d1181f6b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.155485 May 10 20:21:22.848079 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 320/627] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:22 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:22.871082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:22.871588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:22.877935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:22.878637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:22.879418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:22.879859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:22.907969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:21:23.218127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a3550c1-1586-423b-99d2-b5b38f282a75 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 204 len: 0 microversion: 2.1 time: 0.353050 May 10 20:21:23.218724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 308/628] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:21:22 2022] DELETE /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:21:23.226738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:23.227350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:23.233430 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:23.233890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:23.234731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:23.235192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:23.366876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:23.374214 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-afa87f79-a685-4b40-b49c-ceac33211347 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1554 microversion: 2.1 time: 0.151279 May 10 20:21:23.374781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 321/629] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:23 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:23.867186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:23.867901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:23.873863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:23.874493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:23.875084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:23.875516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:24.005314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:24.013701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:24.015250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:24.016414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-45f17a45-1c41-4fba-b550-a250b7aa3a95 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.153477 May 10 20:21:24.016987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 309/630] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:23 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:24.391852 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:24.392458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:24.399542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:24.399989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:24.400752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:24.401177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:24.527241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:24.534493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-df262917-0c43-4b53-8c7d-f27501a22691 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1554 microversion: 2.1 time: 0.146426 May 10 20:21:24.535051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 322/631] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:24 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:25.035320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:25.035932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:25.042251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:25.042721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:25.043497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:25.043933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:25.264824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:25.272562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:25.274115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:25.275290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f19d9522-e42f-4c9b-96d7-b62490938bdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1725 microversion: 2.20 time: 0.243879 May 10 20:21:25.276059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 310/632] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:25 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:25.552551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:25.553101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:25.560116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:25.560566 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:25.561353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:25.561792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:25.706845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:25.714568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4e5e0a53-0feb-45d3-b002-f3f92ed895f7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1554 microversion: 2.1 time: 0.166072 May 10 20:21:25.715454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 323/633] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:25 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:26.292945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:26.293561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:26.300828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.301524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.302543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.302996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.393831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:26.407297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:26.409066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:26.410436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ac5935d6-cc07-483b-bbfa-cd779f605ea3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1657 microversion: 2.20 time: 0.121422 May 10 20:21:26.411171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 311/634] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:26 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1657 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:26.443727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f842ca3e-6ace-4332-90db-1ac5971d52e9 req-c3396de1-519a-40d7-b9bd-ec34049a2487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063dab1-512d-48bb-be6f-807abc044f02", "name": "network-vif-deleted", "tag": "d73b582c-8472-4325-800b-b5cb2624c200"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:26.453306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f842ca3e-6ace-4332-90db-1ac5971d52e9 req-c3396de1-519a-40d7-b9bd-ec34049a2487 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.453754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f842ca3e-6ace-4332-90db-1ac5971d52e9 req-c3396de1-519a-40d7-b9bd-ec34049a2487 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.466824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f842ca3e-6ace-4332-90db-1ac5971d52e9 req-c3396de1-519a-40d7-b9bd-ec34049a2487 service nova] Creating event network-vif-deleted:d73b582c-8472-4325-800b-b5cb2624c200 for instance e063dab1-512d-48bb-be6f-807abc044f02 on hv-cinder-82880 May 10 20:21:26.472049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f842ca3e-6ace-4332-90db-1ac5971d52e9 req-c3396de1-519a-40d7-b9bd-ec34049a2487 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033811 May 10 20:21:26.472655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 324/635] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:26.732356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:26.733085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:26.739672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.740210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.741210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.741711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.788620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:26.789611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:26.790183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lazy-loading 'fault' on Instance uuid e063dab1-512d-48bb-be6f-807abc044f02 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:21:26.833469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5b649235d646fea59e7e61e7e6d8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b135986dfe1f499a9655ac3faee4bbbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:26.842341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6c0891aa-f28b-483a-b814-0f61240d03d7 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 200 len: 1349 microversion: 2.1 time: 0.114225 May 10 20:21:26.844264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 312/636] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:26 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:27.432262 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:27.432803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:27.439667 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:27.440121 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:27.440905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:27.441340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:27.474129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:27.474891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:27.475299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lazy-loading 'fault' on Instance uuid 5ab6f0a6-aa14-407a-b43d-7b7d2855499d {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:21:27.518825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:27.527993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:27.529499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:27.530679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-24b186f3-6500-4eb5-84e8-580a0eef463d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 200 len: 1371 microversion: 2.20 time: 0.105508 May 10 20:21:27.531241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 325/637] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:27 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:27.858908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:27.859475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] [instance: e063dab1-512d-48bb-be6f-807abc044f02] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:27.865833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:27.866531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:27.867930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:27.868793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:27.884760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] HTTP exception thrown: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Request method failure captured: May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 HTTP/1.1 May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesh7C57XNmyfH0EZ--mu8x-ohxOwdTpnD1PkSB1bEm2EueWcADWq53BOTc93H9TEu4N24Ho1dG3lixcVsAlOb30DIlMg-qcPlMxfHhr7SZN2K9zBWV41t-pFBDT6lT1HsrA0zM5fiCBpWXa_taQtKkEl3O8mOJqDGj_oJkdymDQ6Boo May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: b135986dfe1f499a9655ac3faee4bbbf May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:21:27.886441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b135986dfe1f499a9655ac3faee4bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b135986dfe1f499a9655ac3faee4bbbf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: b135986dfe1f499a9655ac3faee4bbbf May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1471470695 May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-TestMinimumBasicScenario-1471470695-project May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 6f5b649235d646fea59e7e61e7e6d8a9 May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestMinimumBasicScenario-1471470695-project May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. May 10 20:21:27.887711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'e063dab1-512d-48bb-be6f-807abc044f02'} May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:21:27.888464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. May 10 20:21:27.889855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:27.891271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Returning 404 to user: Instance e063dab1-512d-48bb-be6f-807abc044f02 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:21:27.891271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eaff3633-9e52-475b-a102-a5747f480209 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02" status: 404 len: 111 microversion: 2.1 time: 0.032904 May 10 20:21:27.891897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 313/638] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:27 2022] GET /compute/v2.1/servers/e063dab1-512d-48bb-be6f-807abc044f02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:21:27.896927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d17e031-3751-46e4-8a82-43e565070b83 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] Calling method '.version_select at 0x7f60290e1ee0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:27.973663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d17e031-3751-46e4-8a82-43e565070b83 tempest-TestMinimumBasicScenario-1471470695 tempest-TestMinimumBasicScenario-1471470695-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1132298356" status: 202 len: 0 microversion: 2.1 time: 0.080654 May 10 20:21:27.974299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 326/639] 10.222.0.65 () {58 vars in 1271 bytes} [Tue May 10 20:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1132298356 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:21:28.489691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-8052b6e8-d613-43ef-a566-1228e3ace817 req-2a4c8433-5e09-4db8-a89c-b3c51aae5d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab6f0a6-aa14-407a-b43d-7b7d2855499d", "name": "network-vif-deleted", "tag": "7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:28.498414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-8052b6e8-d613-43ef-a566-1228e3ace817 req-2a4c8433-5e09-4db8-a89c-b3c51aae5d51 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:28.498867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-8052b6e8-d613-43ef-a566-1228e3ace817 req-2a4c8433-5e09-4db8-a89c-b3c51aae5d51 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:28.509786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-8052b6e8-d613-43ef-a566-1228e3ace817 req-2a4c8433-5e09-4db8-a89c-b3c51aae5d51 service nova] Creating event network-vif-deleted:7f5adb73-ce2a-4cda-9cc2-cdfbc23e98f2 for instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d on hv-cinder-82880 May 10 20:21:28.515001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-8052b6e8-d613-43ef-a566-1228e3ace817 req-2a4c8433-5e09-4db8-a89c-b3c51aae5d51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028912 May 10 20:21:28.515590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 314/640] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:28.549256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:28.549942 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:28.556786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:28.557310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:28.558213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:28.558713 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:28.571963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d HTTP/1.1 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:21:28.573775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:21:28.575468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '5ab6f0a6-aa14-407a-b43d-7b7d2855499d'} May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:21:28.576663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:21:28.578200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:28.579498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:21:28.579498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7169c67c-6734-4ee9-ae43-335d01145075 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 404 len: 111 microversion: 2.20 time: 0.032003 May 10 20:21:28.582040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 327/641] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:28 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:21:28.590005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-972ce0e2-197c-43b3-9d98-4131f7514cbe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '.version_select at 0x7f60290483a0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:28.716060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-972ce0e2-197c-43b3-9d98-4131f7514cbe tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326934519" status: 204 len: 0 microversion: 2.20 time: 0.130207 May 10 20:21:28.716571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 315/642] 10.222.0.65 () {60 vars in 1261 bytes} [Tue May 10 20:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326934519 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:21:29.604390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8a11af84-6f21-4b84-9ec0-3473f188875f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: .version_select at 0x7f60290c48b0>, body: {"keypair": {"name": "tempest-keypair-124578762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbt449iAYSpS7ghdifybCRYB7oCag56p5nZcN4zjSdFBVStTiDXufLU7lF687TXkzMkur6Q6tXi26G7+s7+/BVCP+E3RNSeImH2ur+jCzxlofkDeeYIRYhqtK1k1qLjTw=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:29.619429 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8a11af84-6f21-4b84-9ec0-3473f188875f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:21:29.627722 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8a11af84-6f21-4b84-9ec0-3473f188875f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for user 8feebf7f09cb4f7d81759f8f1336dba5 and project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:21:29.712143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8a11af84-6f21-4b84-9ec0-3473f188875f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.111568 May 10 20:21:29.712912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 328/643] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 10 20:21:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 10 20:21:31.894099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1398222231", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e95ad3ef-7b5f-4775-9b13-3ca347d35ec6"}], "security_groups": [{"name": "tempest-securitygroup--755722370"}], "key_name": "tempest-keypair-124578762", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:32.005728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] validate_networks() for [('e95ad3ef-7b5f-4775-9b13-3ca347d35ec6', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:21:32.229111 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:32.230032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:32.237119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.237827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.238810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.239245 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.268611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-24477190-b772-45c2-97bd-5afb30b25d9c tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043812 May 10 20:21:32.274411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 329/644] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:32 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 20:21:32.332794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:32.337004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:32.355738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.357420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.359137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.359672 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.394904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:21:32.395472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:21:32.396051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:21:32.396566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:21:32.397185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:21:32.402403 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:21:32.413907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.414543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.417112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.417112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.440947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:21:32.450507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Getting quotas for user 8feebf7f09cb4f7d81759f8f1336dba5 and project d5cecfb8eb5e4b8ea121c2ef8a9c28a2. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:21:32.460556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:21:32.463581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:21:32.597217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-153d30a4-0812-4303-89a9-a71175462547 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.708234 May 10 20:21:32.598464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 316/645] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 10 20:21:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 20:21:32.612656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:32.613282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:32.674801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:32.683898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:32.697238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:32.697238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-57aad2be-54fb-497c-a901-afb3b9a48cdb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1281 microversion: 2.20 time: 0.082039 May 10 20:21:32.697238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 317/646] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:32 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:32.707724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f5b9031-fc63-41d1-8a0a-4d28f3d06e2a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 204 len: 0 microversion: 2.1 time: 0.384363 May 10 20:21:32.708994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 330/647] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:21:32 2022] DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:21:32.717191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:32.717954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:32.724769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.725167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.725975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:32.726557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:32.912990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:32.921322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ce4306c-389f-4844-9569-d8427fbbc69a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1672 microversion: 2.1 time: 0.207934 May 10 20:21:32.922482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 318/648] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:32 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:33.705754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:33.706424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:33.713401 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:33.713840 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:33.717876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:33.717876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:33.776482 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:33.784219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:33.785741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:33.786870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-436ffccc-9331-4738-b94a-370d2cf87aff tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1285 microversion: 2.20 time: 0.085843 May 10 20:21:33.787658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 331/649] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:33 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:33.939452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:33.940049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:33.947215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:33.947659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:33.948434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:33.948863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:34.208786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:34.216323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-801e309f-69ef-40c9-88e4-77cb1bd5a1c0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1672 microversion: 2.1 time: 0.280818 May 10 20:21:34.216991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 319/650] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:33 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1672 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:34.803728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:34.804265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:34.811358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:34.811807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:34.812570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:34.813040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:34.883404 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:34.894635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:34.896839 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:34.898215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-210dd396-3489-434a-b15d-ed6c84bcd981 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1285 microversion: 2.20 time: 0.098455 May 10 20:21:34.899775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 332/651] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:34 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:35.233167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:35.233797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:35.240089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:35.240725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:35.241501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:35.241941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:35.548914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:35.557075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-402e8883-765b-4518-890b-d6edd88ac7a0 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1672 microversion: 2.1 time: 0.327786 May 10 20:21:35.558201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 320/652] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:35 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1672 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:35.916738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:35.917336 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:35.923737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:35.924182 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:35.924949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:35.925379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:35.991412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:35.999938 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:36.001623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:36.002755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2138d6e2-9a10-4678-9133-07872449d314 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1351 microversion: 2.20 time: 0.090502 May 10 20:21:36.003334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 333/653] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:35 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:36.574783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:36.577333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:36.592211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:36.593039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:36.594173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:36.606968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:36.819891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-b480e377-f12a-46c0-a163-40129882273e req-7efbe74b-7111-4064-9b74-24023b934d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f6cc79-11c0-4244-ac21-ac182db7d7cc", "name": "network-vif-deleted", "tag": "f3ad9929-2cb4-4711-9a32-8294a05717b6"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:36.831736 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b480e377-f12a-46c0-a163-40129882273e req-7efbe74b-7111-4064-9b74-24023b934d5f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:36.832435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b480e377-f12a-46c0-a163-40129882273e req-7efbe74b-7111-4064-9b74-24023b934d5f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:36.852789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-b480e377-f12a-46c0-a163-40129882273e req-7efbe74b-7111-4064-9b74-24023b934d5f service nova] Creating event network-vif-deleted:f3ad9929-2cb4-4711-9a32-8294a05717b6 for instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc on hv-cinder-82880 May 10 20:21:36.863832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-b480e377-f12a-46c0-a163-40129882273e req-7efbe74b-7111-4064-9b74-24023b934d5f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044311 May 10 20:21:36.868806 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 334/654] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:21:37.025404 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:37.026203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:37.056660 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:37.057126 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:37.057925 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:37.064067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:37.119939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:37.140789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-738ee12e-5c95-4932-83d8-e0ef077f37d7 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 200 len: 1604 microversion: 2.1 time: 0.569577 May 10 20:21:37.144336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 321/655] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:36 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 1604 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:37.378279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:37.386876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:37.388384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:37.389499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9325694e-1c0c-4cde-a322-1954c7c38091 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.372334 May 10 20:21:37.390063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 335/656] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:37 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:21:38.159518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:38.162915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:38.170748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:38.171302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:38.172182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:38.172851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:38.189921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc HTTP/1.1 May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:21:38.192186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:21:38.198962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '25f6cc79-11c0-4244-ac21-ac182db7d7cc'} May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:21:38.199837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:21:38.201660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:21:38.203004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:21:38.203004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-66e78e37-f387-4546-955a-2b04923e8346 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 404 len: 111 microversion: 2.1 time: 0.039002 May 10 20:21:38.203004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 322/657] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:38 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:21:38.204331 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3a994c9d-0277-4a91-a119-b775b7e3d2af tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '.version_select at 0x7f60290e1310>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:38.311189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3a994c9d-0277-4a91-a119-b775b7e3d2af tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167115024" status: 202 len: 0 microversion: 2.1 time: 0.110949 May 10 20:21:38.311782 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 336/658] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 20:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167115024 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:21:38.421957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:38.421957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:38.424327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:38.426480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:38.437569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:38.438312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:38.685199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:38.698527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:38.705813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:38.707281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ce523a9-dbf7-4499-957f-bb9ceb29f95f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.297331 May 10 20:21:38.708523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 323/659] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:38 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:38.953147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-5a708004-62a0-4124-b33d-8756d78fd9b4 req-25593dfd-3f53-4ccf-9e3c-01abe6a1bcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:38.969678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5a708004-62a0-4124-b33d-8756d78fd9b4 req-25593dfd-3f53-4ccf-9e3c-01abe6a1bcb6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:38.971973 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-5a708004-62a0-4124-b33d-8756d78fd9b4 req-25593dfd-3f53-4ccf-9e3c-01abe6a1bcb6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:38.985492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-5a708004-62a0-4124-b33d-8756d78fd9b4 req-25593dfd-3f53-4ccf-9e3c-01abe6a1bcb6 service nova] Creating event network-changed:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:21:38.990935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-5a708004-62a0-4124-b33d-8756d78fd9b4 req-25593dfd-3f53-4ccf-9e3c-01abe6a1bcb6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045776 May 10 20:21:38.999686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 337/660] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:39.733774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:39.733774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:39.734998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:39.735522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:39.736322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:39.736765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:39.752186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ea2a4ff9-c853-4c26-8e87-e122d8dbff3f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: .version_select at 0x7f602e2a6670>, body: {"keypair": {"name": "tempest-keypair-1874849454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOctVpwd9loDR6TorAFvBrStvCxezhDfC78NWxfkglNqsFidE8FvQkYIMebJkc8XruhTy1Ws40wSMkyCBLFbTDN8G3UD+SeEhR3crNPpcPurKAOEZ5l6XjLc/JIkJDq8YQ=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:39.771293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ea2a4ff9-c853-4c26-8e87-e122d8dbff3f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:21:39.775276 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ea2a4ff9-c853-4c26-8e87-e122d8dbff3f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for user 35e69662bc7648b8b3e7467cf56c7f5e and project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:21:39.872314 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ea2a4ff9-c853-4c26-8e87-e122d8dbff3f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126750 May 10 20:21:39.873281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 338/661] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:21:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:39.879366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:39.887391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:39.888873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:39.889978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c4555225-f1e5-4201-830e-4b488f2ed5a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.166912 May 10 20:21:39.891285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 324/662] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:39 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:40.911512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:40.912232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:40.921991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:40.922461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:40.923223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:40.923655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:41.294735 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:41.302871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:41.304370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:41.305514 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-005f7bbc-d565-4142-8a83-a0a29dcc6361 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.397886 May 10 20:21:41.311507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 339/663] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:40 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:42.214852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-400855945", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b00b815-407a-4d47-9742-67b948c39d25"}], "security_groups": [{"name": "tempest-securitygroup--445830035"}], "key_name": "tempest-keypair-1874849454", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:42.315395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] validate_networks() for [('2b00b815-407a-4d47-9742-67b948c39d25', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:21:42.322900 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:42.323593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:42.330295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:42.330749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:42.331526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:42.331957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:42.469136 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:42.478251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:42.493154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:42.493154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19b61c9e-a9a6-45b6-a91b-3ff2bf1025d9 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.162607 May 10 20:21:42.493154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 340/664] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:42 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:21:42.690024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:21:42.690553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:21:42.691067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:21:42.691474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:21:42.691885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:21:42.700204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:42.700649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:42.701722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:42.702180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:42.717919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:21:42.721601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Getting quotas for user 35e69662bc7648b8b3e7467cf56c7f5e and project 821dc2c3061041a3ab6ee939c306a7ea. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:21:42.732682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:21:42.734781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:21:42.842414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-03170963-b065-4283-8fbf-72a40782c1e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.632243 May 10 20:21:42.843156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 325/665] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:21:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:21:42.853302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b8ce7800-d77e-41e9-9929-d6c0ad954769 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:42.853917 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b8ce7800-d77e-41e9-9929-d6c0ad954769 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:42.905464 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b8ce7800-d77e-41e9-9929-d6c0ad954769 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:42.912118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b8ce7800-d77e-41e9-9929-d6c0ad954769 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1237 microversion: 2.1 time: 0.063043 May 10 20:21:42.912690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 341/666] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:42 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:43.501221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:43.501221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:43.506090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:43.506537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:43.507472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:43.507903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:43.639631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:43.647394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:43.648980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:43.650733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1d0e5ca8-5a84-479d-b8bd-4b584c94669f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.155540 May 10 20:21:43.651282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 326/667] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:43 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:43.928874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:43.929488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:43.937043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:43.937495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:43.938340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:43.938781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:43.999308 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:44.006653 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-67c7cbfb-7c0b-4341-a7ab-c41894ed5f38 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1241 microversion: 2.1 time: 0.081576 May 10 20:21:44.007224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 342/668] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:43 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:44.102428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-36320e81-9750-470a-94c6-0702f0ec8e46 req-8a3df9aa-bcc1-4b81-90ba-af3a8aa9fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "name": "network-vif-plugged", "status": "completed", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:44.111803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-36320e81-9750-470a-94c6-0702f0ec8e46 req-8a3df9aa-bcc1-4b81-90ba-af3a8aa9fcd6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.112415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-36320e81-9750-470a-94c6-0702f0ec8e46 req-8a3df9aa-bcc1-4b81-90ba-af3a8aa9fcd6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.125667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-36320e81-9750-470a-94c6-0702f0ec8e46 req-8a3df9aa-bcc1-4b81-90ba-af3a8aa9fcd6 service nova] Creating event network-vif-plugged:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:21:44.133323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-36320e81-9750-470a-94c6-0702f0ec8e46 req-8a3df9aa-bcc1-4b81-90ba-af3a8aa9fcd6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036675 May 10 20:21:44.133989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 327/669] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:44.549803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:44.550323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:44.556145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.556594 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.557355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.557788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.634728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lazy-loading 'services' on Instance uuid 072e9288-fad4-458c-bf1b-66246d9d51ca {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:21:44.670228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:44.671040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:44.677027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.679532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.679532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.679532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.810933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:44.818638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:44.820150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:44.821255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c14205c-48a7-4e70-a8ab-db0fdd7be447 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.156564 May 10 20:21:44.821825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 328/670] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:44 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:44.880802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-10d56c29-0be8-4a85-8a7a-e7338f6a23e6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments/276bb01e-3b65-4292-b8ce-691e3e0b66ff" status: 202 len: 0 microversion: 2.1 time: 0.334712 May 10 20:21:44.881435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 343/671] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:21:44 2022] DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments/276bb01e-3b65-4292-b8ce-691e3e0b66ff => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:21:44.889636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:44.890610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:44.896397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.896846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.897620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:44.898064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:44.928130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0f07ce1-ecf5-4757-aa03-91264a969e48 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042296 May 10 20:21:44.928705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 329/672] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:44 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:45.024022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:45.025304 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:45.031911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.032558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.033432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.033989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.099999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:45.107360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e78aa4ac-1f2e-416f-b778-09fc081785de tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1289 microversion: 2.1 time: 0.088065 May 10 20:21:45.108195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 344/673] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:45 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:45.838842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:45.839433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:45.845646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.849721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.849721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.849721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.948781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:45.949771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:45.955871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.958572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.958572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:45.958572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:45.985686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:45.990954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8bc6a78c-b351-4a80-823d-5733cf4ae834 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 May 10 20:21:45.991559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 345/674] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:45 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:21:45.994183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:45.995689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:45.996798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1db93b58-4164-4ae3-bd52-91b24e1eccc7 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1406 microversion: 2.20 time: 0.161949 May 10 20:21:45.997350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 330/675] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:45 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:46.124968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:46.125500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:46.131810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:46.132257 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:46.133016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:46.133448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:46.197700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:46.209047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c3722d33-7e2e-464b-b70f-72d1b11e8b92 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1297 microversion: 2.1 time: 0.087942 May 10 20:21:46.209954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 346/676] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:46 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:47.017008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.018252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.026231 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.026927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.028058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.028658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.174971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:47.185455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:47.188510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:47.190396 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fae8d4f8-df0e-4c11-b784-939ad488fc78 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1599 microversion: 2.20 time: 0.177487 May 10 20:21:47.191480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 347/677] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:21:47 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:21:47.192879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.193923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.200468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.201009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.202151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.202801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.212413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.213150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.220090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.221801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.221801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.221801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.236823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7bb9cca-ba16-4f36-b2fb-f48f6c9a2527 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.237505 May 10 20:21:47.237409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 331/678] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:21:46 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca/os-volume_attachments => generated 25 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:21:47.250337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.251314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.258007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.258547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.259468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.260007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.319904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eac5b1ee-e480-4aeb-9923-b00ddf96af1d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115367 May 10 20:21:47.320945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 348/679] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 10 20:21:47 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:21:47.325680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.326313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.333226 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.333757 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.334644 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.335151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.360626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:21:47.475620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:47.483949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1b405577-f8ee-4571-ad43-78b3fd9fc5e4 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.245462 May 10 20:21:47.484812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 332/680] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:47 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:47.699032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e979af2a-bbdd-4a95-8859-aecece931040 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 204 len: 0 microversion: 2.1 time: 0.376572 May 10 20:21:47.699986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 349/681] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:21:47 2022] DELETE /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:21:47.708161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:47.708777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:47.717259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.717873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.718497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:47.718936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:47.933457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:47.940835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4359152b-fe7b-42be-a680-16c3e19a2026 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1687 microversion: 2.1 time: 0.236514 May 10 20:21:47.941416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 333/682] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:47 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:48.046645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-45a98567-9d99-42ff-ae11-aedaad689d28 req-1e9bd744-f60d-4294-bb16-1b82f8526d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eee18d5-fa67-4cab-b9ce-a94bf66579fb", "tag": "1ffedcb9-4d80-458b-b618-d76c58afd63f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:48.055431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-45a98567-9d99-42ff-ae11-aedaad689d28 req-1e9bd744-f60d-4294-bb16-1b82f8526d51 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.056009 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-45a98567-9d99-42ff-ae11-aedaad689d28 req-1e9bd744-f60d-4294-bb16-1b82f8526d51 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:48.073514 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-45a98567-9d99-42ff-ae11-aedaad689d28 req-1e9bd744-f60d-4294-bb16-1b82f8526d51 service nova] Creating event network-changed:1ffedcb9-4d80-458b-b618-d76c58afd63f for instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb on hv-cinder-82880 May 10 20:21:48.079542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-45a98567-9d99-42ff-ae11-aedaad689d28 req-1e9bd744-f60d-4294-bb16-1b82f8526d51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039606 May 10 20:21:48.080349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 350/683] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:48.502132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:48.503468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:48.510427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.510877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:48.511654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.512604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:48.646327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:48.653672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc0abe71-7233-4873-abfa-77a698595a01 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.155437 May 10 20:21:48.662793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 334/684] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:48 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:48.672648 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a6787075-8af9-40e8-bbaf-9df4704fa12b req-eda6b3be-f089-4a6f-a491-5a7495cc67a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:48.681796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a6787075-8af9-40e8-bbaf-9df4704fa12b req-eda6b3be-f089-4a6f-a491-5a7495cc67a0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.682209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a6787075-8af9-40e8-bbaf-9df4704fa12b req-eda6b3be-f089-4a6f-a491-5a7495cc67a0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:48.693147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a6787075-8af9-40e8-bbaf-9df4704fa12b req-eda6b3be-f089-4a6f-a491-5a7495cc67a0 service nova] Creating event network-changed:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:21:48.699876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a6787075-8af9-40e8-bbaf-9df4704fa12b req-eda6b3be-f089-4a6f-a491-5a7495cc67a0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029692 May 10 20:21:48.699876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 351/685] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:48.958602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:48.959131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:48.966114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.966588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:48.967374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:48.967807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:49.095937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:49.103876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-78e7fe57-5f2f-46a8-9c98-cf428bdb03cb tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1687 microversion: 2.1 time: 0.149352 May 10 20:21:49.104462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 335/686] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:48 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:49.671343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:49.676081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:49.679619 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:49.680074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:49.680868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:49.681308 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:49.814994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:49.822874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8a960db-34f8-406f-afcb-3d0784717b41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.155790 May 10 20:21:49.823449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 352/687] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:49 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:50.121301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:50.121835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:50.128189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:50.128646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:50.129419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:50.129860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:50.255186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:50.262560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1bffc70e-502c-4685-8f4e-90d8521b7c46 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1687 microversion: 2.1 time: 0.145691 May 10 20:21:50.263160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 336/688] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:50 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1687 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:50.840370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:50.840987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:50.847730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:50.848183 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:50.848964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:50.849402 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:51.044574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:51.053577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c9fa2d2b-85df-4678-baf9-bdf877a9b078 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.217443 May 10 20:21:51.054540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 353/689] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:50 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:21:51.281360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:51.281990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:51.289185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:51.289703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:51.290540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:51.290980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:51.616485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:51.624425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-13696ee3-7d12-4890-91f7-6a446ad7e171 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1687 microversion: 2.1 time: 0.348287 May 10 20:21:51.625094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 337/690] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:51 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1687 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:52.070575 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:52.071334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:52.078573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:52.079096 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:52.079940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:52.080480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:52.220136 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:52.229229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b052adf7-149e-4ff4-9248-d92e9362085a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.162370 May 10 20:21:52.230258 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 354/691] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:52 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:52.511277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-26bc5083-29f6-4eb6-a501-6edffb1f173c req-df3bc2ec-e946-40f8-9e60-5266bd12aae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072e9288-fad4-458c-bf1b-66246d9d51ca", "name": "network-vif-deleted", "tag": "6ce065a5-1fd8-4282-bd44-02c414d92466"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:52.519592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-26bc5083-29f6-4eb6-a501-6edffb1f173c req-df3bc2ec-e946-40f8-9e60-5266bd12aae3 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:52.519983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-26bc5083-29f6-4eb6-a501-6edffb1f173c req-df3bc2ec-e946-40f8-9e60-5266bd12aae3 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:52.531211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-26bc5083-29f6-4eb6-a501-6edffb1f173c req-df3bc2ec-e946-40f8-9e60-5266bd12aae3 service nova] Creating event network-vif-deleted:6ce065a5-1fd8-4282-bd44-02c414d92466 for instance 072e9288-fad4-458c-bf1b-66246d9d51ca on hv-cinder-82880 May 10 20:21:52.536300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-26bc5083-29f6-4eb6-a501-6edffb1f173c req-df3bc2ec-e946-40f8-9e60-5266bd12aae3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029147 May 10 20:21:52.536895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 338/692] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:21:52.642498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:52.643105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:52.649071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:52.650256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:52.651041 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:52.651477 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:52.725322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:52.732862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-036e3cf8-d2ac-444c-82e8-791da1f85672 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 200 len: 1620 microversion: 2.1 time: 0.094323 May 10 20:21:52.742117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 355/693] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:52 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 1620 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:21:53.248895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:53.249932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:53.260428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:53.260905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:53.261687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:53.262146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:53.419518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:53.427071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd9e47e1-080f-4519-9f11-41c9558ba6e5 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.184452 May 10 20:21:53.427651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 339/694] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:53 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:53.753737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:53.754346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 072e9288-fad4-458c-bf1b-66246d9d51ca] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:53.760667 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:53.761112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:53.761877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:53.762335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:53.776273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] HTTP exception thrown: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Request method failure captured: May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca HTTP/1.1 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesguU84PRPrLb4L0FhSaDenHglcTDETqiJr2k5Hq2mgdPBKFLHuiDsxayhPUqrCJdQCRizrald5EKV-eQru44uODOrnFKR5SyQUecbx0zJ49xtuH7XWhJtaHFgdC0Cx7fFjqB43hilR29zEinoUUOGT_5KsBvjmcCEnpc7iXFlyBB3A May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:21:53.777931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d38de3da9e3489ebbbebd4f8aeb0d49", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 261d01f5b22340a09708c71be64edae8 May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. May 10 20:21:53.779657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '072e9288-fad4-458c-bf1b-66246d9d51ca'} May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:21:53.780474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. May 10 20:21:53.781956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:21:53.783385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Returning 404 to user: Instance 072e9288-fad4-458c-bf1b-66246d9d51ca could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:21:53.783385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6a79cef0-008f-441c-9fc5-9b7bbb2508c2 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca" status: 404 len: 111 microversion: 2.1 time: 0.029435 May 10 20:21:53.783385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 356/695] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:53 2022] GET /compute/v2.1/servers/072e9288-fad4-458c-bf1b-66246d9d51ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:21:53.788038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-511df140-b973-41ea-8805-85a1031b6ff0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '.version_select at 0x7f6028f6d160>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:53.860317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-511df140-b973-41ea-8805-85a1031b6ff0 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48266751" status: 202 len: 0 microversion: 2.1 time: 0.076072 May 10 20:21:53.860906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 340/696] 10.222.0.65 () {58 vars in 1214 bytes} [Tue May 10 20:21:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48266751 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:21:54.443971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:54.444624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:54.451035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:54.451487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:54.452514 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:54.452949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:54.603004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:54.610877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6f333bb6-7f46-4731-ab85-eb26887b669f tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.170703 May 10 20:21:54.616680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 357/697] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:54 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:55.629081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:55.629638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:55.636522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:55.636969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:55.638361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:55.638361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:55.766674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:55.773897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ce913f7-8a37-4bfe-bd67-88ec9c514fca tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.149288 May 10 20:21:55.774488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 341/698] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:55 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:56.198761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f9d7e875-2787-43dd-8018-2ee86f143090 req-1fa56784-e480-4b3c-95f4-a48f2b2493ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eee18d5-fa67-4cab-b9ce-a94bf66579fb", "name": "network-vif-plugged", "status": "completed", "tag": "1ffedcb9-4d80-458b-b618-d76c58afd63f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:21:56.215706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f9d7e875-2787-43dd-8018-2ee86f143090 req-1fa56784-e480-4b3c-95f4-a48f2b2493ca service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:56.216156 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f9d7e875-2787-43dd-8018-2ee86f143090 req-1fa56784-e480-4b3c-95f4-a48f2b2493ca service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:56.226721 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f9d7e875-2787-43dd-8018-2ee86f143090 req-1fa56784-e480-4b3c-95f4-a48f2b2493ca service nova] Creating event network-vif-plugged:1ffedcb9-4d80-458b-b618-d76c58afd63f for instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb on hv-cinder-82880 May 10 20:21:56.231483 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f9d7e875-2787-43dd-8018-2ee86f143090 req-1fa56784-e480-4b3c-95f4-a48f2b2493ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037240 May 10 20:21:56.232072 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 358/699] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:56.840467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.841087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:56.846941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:56.847399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:56.848172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:56.848610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:56.976705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:56.984529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-03f26ee5-8cd1-46ca-9e03-1f0b8a527d17 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.197239 May 10 20:21:56.985101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 342/700] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:57.237550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:57.238153 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:57.244315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:57.248351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:57.248351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:57.248351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:57.271062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:21:57.561888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aa02f822-5ff3-4809-940d-0acf8b142b2c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 204 len: 0 microversion: 2.1 time: 0.328567 May 10 20:21:57.562825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 359/701] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:21:57 2022] DELETE /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:21:57.570826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:57.571711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:57.578350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:57.578807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:57.579580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:57.580019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:57.706637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:57.713917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-79999d69-1e25-464a-afff-dc944f2e56b4 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1507 microversion: 2.1 time: 0.146921 May 10 20:21:57.714551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 343/702] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:57 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:58.001867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:58.002597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:58.008511 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:58.008965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:58.009733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:58.010201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:58.145354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:58.153247 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-327d3f85-db70-486f-9294-2ffb2be8ab05 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.155636 May 10 20:21:58.153813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 360/703] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:57 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:58.731666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:58.732279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:58.738750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:58.739196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:58.739961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:58.740398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:58.869517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:58.877359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-172fd8bf-fa56-40cf-a328-3e9f0baace5a tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1507 microversion: 2.1 time: 0.150194 May 10 20:21:58.877963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 344/704] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:58 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:59.169738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:59.170295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:59.176526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:59.176975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:59.177740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:59.178200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:59.305050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:21:59.312851 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-95f27b8b-5d1b-40f1-be0a-9000b7baf9ac tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1362 microversion: 2.1 time: 0.147007 May 10 20:21:59.313418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 361/705] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:59 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:59.894930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:59.895456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:21:59.901854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:59.902844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:21:59.903609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:21:59.904044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.030068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:00.037325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d998ccb8-2fa3-420f-bfa9-1062b8d9efed tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1507 microversion: 2.1 time: 0.146336 May 10 20:22:00.037949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 345/706] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:21:59 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:00.330380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:00.331021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:00.337275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:00.337719 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.338524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:00.338960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.469737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:00.477166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-375a52dd-092a-4de9-b6a9-db7432b5d4be tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1547 microversion: 2.1 time: 0.151019 May 10 20:22:00.477825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 362/707] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:00 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:00.493469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:00.494186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:00.500679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:00.501166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.501949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:00.502592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.605484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d634651-c353-452f-83b4-2d664b54aeea tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115429 May 10 20:22:00.606179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 346/708] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:22:00 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:22:00.871708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-67fbe763-1d9d-49d7-8e89-fca6461af1d8 req-a9ce20a6-4b01-42a2-a425-305c4ba050cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6760c43d-64a5-4cbf-b559-07d871e81f18", "name": "network-vif-deleted", "tag": "d09063b0-3b3a-44ec-8588-f6884472f3ad"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:00.881192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-67fbe763-1d9d-49d7-8e89-fca6461af1d8 req-a9ce20a6-4b01-42a2-a425-305c4ba050cb service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:00.881192 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-67fbe763-1d9d-49d7-8e89-fca6461af1d8 req-a9ce20a6-4b01-42a2-a425-305c4ba050cb service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:00.892377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-67fbe763-1d9d-49d7-8e89-fca6461af1d8 req-a9ce20a6-4b01-42a2-a425-305c4ba050cb service nova] Creating event network-vif-deleted:d09063b0-3b3a-44ec-8588-f6884472f3ad for instance 6760c43d-64a5-4cbf-b559-07d871e81f18 on hv-cinder-82880 May 10 20:22:00.897484 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-67fbe763-1d9d-49d7-8e89-fca6461af1d8 req-a9ce20a6-4b01-42a2-a425-305c4ba050cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098910 May 10 20:22:00.898201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 363/709] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:01.055028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:01.055554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:01.062050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:01.065010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:01.065010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:01.065010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:01.100564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:01.101018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:01.101469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lazy-loading 'fault' on Instance uuid 6760c43d-64a5-4cbf-b559-07d871e81f18 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:22:01.146197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:01.154476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-796ce726-539f-4608-9f10-594950e4df27 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 200 len: 1312 microversion: 2.1 time: 0.103855 May 10 20:22:01.158129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 347/710] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:01 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:01.940415 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-d3ef0ed4-0941-412c-849f-ff1056e985d5 req-cefef986-9246-4725-b33e-78edc7d1131e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eee18d5-fa67-4cab-b9ce-a94bf66579fb", "tag": "1ffedcb9-4d80-458b-b618-d76c58afd63f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:01.948930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d3ef0ed4-0941-412c-849f-ff1056e985d5 req-cefef986-9246-4725-b33e-78edc7d1131e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:01.949373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d3ef0ed4-0941-412c-849f-ff1056e985d5 req-cefef986-9246-4725-b33e-78edc7d1131e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:01.960295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-d3ef0ed4-0941-412c-849f-ff1056e985d5 req-cefef986-9246-4725-b33e-78edc7d1131e service nova] Creating event network-changed:1ffedcb9-4d80-458b-b618-d76c58afd63f for instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb on hv-cinder-82880 May 10 20:22:01.965877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-d3ef0ed4-0941-412c-849f-ff1056e985d5 req-cefef986-9246-4725-b33e-78edc7d1131e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030543 May 10 20:22:01.966505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 364/711] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:02.172036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:02.172554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 6760c43d-64a5-4cbf-b559-07d871e81f18] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:02.179416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.179992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.180854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.181365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.196167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] HTTP exception thrown: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Request method failure captured: May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 HTTP/1.1 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesguU84PRPrLb4L0FhSaDenHglcTDETqiJr2k5Hq2mgdPBKFLHuiDsxayhPUqrCJdQCRizrald5EKV-eQru44uODOrnFKR5SyQUecbx0zJ49xtuH7XWhJtaHFgdC0Cx7fFjqB43hilR29zEinoUUOGT_5KsBvjmcCEnpc7iXFlyBB3A May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:22:02.197935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d38de3da9e3489ebbbebd4f8aeb0d49", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 261d01f5b22340a09708c71be64edae8 May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. May 10 20:22:02.199451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '6760c43d-64a5-4cbf-b559-07d871e81f18'} May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:02.200237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. May 10 20:22:02.201419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:02.203202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Returning 404 to user: Instance 6760c43d-64a5-4cbf-b559-07d871e81f18 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:02.203202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-551539cc-ab63-4b57-a1c2-d2b1413c3e78 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18" status: 404 len: 111 microversion: 2.1 time: 0.032126 May 10 20:22:02.203202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 348/712] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:02 2022] GET /compute/v2.1/servers/6760c43d-64a5-4cbf-b559-07d871e81f18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:22:02.210175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:02.211098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:02.217614 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.218242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.219024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.219456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.245069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:22:02.545413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-158e5ffe-747d-4c47-83e2-c04f8ffb96a7 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 204 len: 0 microversion: 2.1 time: 0.339559 May 10 20:22:02.546470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 365/713] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:22:02 2022] DELETE /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:22:02.554354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:02.554852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:02.561501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.562319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.563377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:02.564049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:02.705140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:02.712378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8cc8ec1b-8a52-42e4-b006-41a2cde78bb6 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.162123 May 10 20:22:02.712942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 349/714] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:02 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:03.729710 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:03.730941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:03.737259 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:03.737712 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:03.738509 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:03.738946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:03.864901 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:03.872743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3d0b7502-9ddf-403c-a9e2-72837d1f927b tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.147334 May 10 20:22:03.873309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 366/715] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:03 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:04.890062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:04.890658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:04.897028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:04.897436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:04.898221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:04.898655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:05.030630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:05.037852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63e1024d-1902-40c7-8c5b-acb6bea9f44c tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.151911 May 10 20:22:05.038442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 350/716] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:04 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:06.054878 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:06.055440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:06.061704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:06.062184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:06.062961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:06.063394 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:06.205559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-85abc1b1-7780-4f0d-8c7b-b53a0af0b921 req-f649a04d-0eb7-4ad4-90e0-3f11f27baced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b", "name": "network-vif-deleted", "tag": "c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:06.211081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261d01f5b22340a09708c71be64edae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38de3da9e3489ebbbebd4f8aeb0d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:06.214038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-85abc1b1-7780-4f0d-8c7b-b53a0af0b921 req-f649a04d-0eb7-4ad4-90e0-3f11f27baced service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:06.216477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-85abc1b1-7780-4f0d-8c7b-b53a0af0b921 req-f649a04d-0eb7-4ad4-90e0-3f11f27baced service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:06.219740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-81407dd0-3765-429e-b844-aee8db28f003 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 200 len: 1520 microversion: 2.1 time: 0.168851 May 10 20:22:06.220559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 367/717] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:06 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:06.225868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-85abc1b1-7780-4f0d-8c7b-b53a0af0b921 req-f649a04d-0eb7-4ad4-90e0-3f11f27baced service nova] Creating event network-vif-deleted:c4a5ca84-aa0d-4ea4-bd3f-21c0643c8972 for instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b on hv-cinder-82880 May 10 20:22:06.231287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-85abc1b1-7780-4f0d-8c7b-b53a0af0b921 req-f649a04d-0eb7-4ad4-90e0-3f11f27baced service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 May 10 20:22:06.231942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 351/718] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:22:07.237438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:07.238044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] [instance: 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:07.244216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:07.244670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:07.245409 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:07.246010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:07.258984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] HTTP exception thrown: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Request method failure captured: May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b HTTP/1.1 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesguU84PRPrLb4L0FhSaDenHglcTDETqiJr2k5Hq2mgdPBKFLHuiDsxayhPUqrCJdQCRizrald5EKV-eQru44uODOrnFKR5SyQUecbx0zJ49xtuH7XWhJtaHFgdC0Cx7fFjqB43hilR29zEinoUUOGT_5KsBvjmcCEnpc7iXFlyBB3A May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:22:07.260621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d38de3da9e3489ebbbebd4f8aeb0d49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d38de3da9e3489ebbbebd4f8aeb0d49", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 9d38de3da9e3489ebbbebd4f8aeb0d49 May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004630497 May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 261d01f5b22340a09708c71be64edae8 May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004630497-project May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. May 10 20:22:07.262319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b'} May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:07.263217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. May 10 20:22:07.264728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:07.266039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] Returning 404 to user: Instance 4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:07.266039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-95ca8ca2-1d7a-44b5-91ed-ddc3f2efa291 tempest-ServerRescueNegativeTestJSON-1004630497 tempest-ServerRescueNegativeTestJSON-1004630497-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b" status: 404 len: 111 microversion: 2.1 time: 0.028599 May 10 20:22:07.266039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 368/719] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:07 2022] GET /compute/v2.1/servers/4c3dabb3-307b-4ae5-8c97-9a7a2c8ddb4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:22:12.887919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-194a9909-12b8-4c9c-b281-854445d4e61d tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Action: 'create', calling method: .version_select at 0x7f6028e74c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-452108739", "metadata": {"Type": "work"}}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-194a9909-12b8-4c9c-b281-854445d4e61d tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 121 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:22:12.905631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-452108739", "metadata": {"Type": "work"}}} May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:22:12.907343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-452108739', 'metadata': {'Type': 'work'}}}} May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise error May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi '#$%' May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:12.908406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:22:12.911009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:22:12.912397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:22:12.912397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.912397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-194a9909-12b8-4c9c-b281-854445d4e61d tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:12.912397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-194a9909-12b8-4c9c-b281-854445d4e61d tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131045 May 10 20:22:12.912397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 352/720] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 20:22:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:22:12.916515 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-863b630f-61d8-4997-9a80-c87119f9bf18 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Action: 'create', calling method: .version_select at 0x7f602e2a6700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-795342940", "metadata": {"Type": "work"}}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-863b630f-61d8-4997-9a80-c87119f9bf18 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 119 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:22:12.920296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-795342940", "metadata": {"Type": "work"}}} May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: May 10 20:22:12.921815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-795342940', 'metadata': {'Type': 'work'}}}} May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise error May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi '0' May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:12.922827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:22:12.924824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:22:12.926448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:22:12.926448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.926448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-863b630f-61d8-4997-9a80-c87119f9bf18 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:12.926448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-863b630f-61d8-4997-9a80-c87119f9bf18 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008948 May 10 20:22:12.926448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 369/721] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 20:22:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:22:12.930424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4c36ad2-e58f-4220-9709-2216e9b66927 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Action: 'create', calling method: .version_select at 0x7f6028e7ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1253767038", "metadata": {"Type": "work"}}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4c36ad2-e58f-4220-9709-2216e9b66927 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 119 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:22:12.933222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1253767038", "metadata": {"Type": "work"}}} May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:22:12.935645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1253767038', 'metadata': {'Type': 'work'}}}} May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise error May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi '' May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:12.936594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:22:12.938308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:22:12.939620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:22:12.939620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:12.939620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4c36ad2-e58f-4220-9709-2216e9b66927 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:12.939620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e4c36ad2-e58f-4220-9709-2216e9b66927 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008689 May 10 20:22:12.939620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 353/722] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 20:22:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:22:12.944880 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb708eef-0f6f-4499-9b3a-ff231d1b2093 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Calling method '.version_select at 0x7f602e23b160>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:12.972658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-eb708eef-0f6f-4499-9b3a-ff231d1b2093 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] HTTP exception thrown: Volume tempest-invalid-856144818 could not be found. May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb708eef-0f6f-4499-9b3a-ff231d1b2093 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-856144818 HTTP/1.1 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:22:12.978981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Volume tempest-invalid-856144818 could not be found. May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': 'tempest-invalid-856144818'} May 10 20:22:12.981076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-856144818 could not be found. (HTTP 404) (Request-ID: req-43229497-6387-42d3-8435-d3fbcf671537) May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.982036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:22:12.983560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-856144818 could not be found. May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:22:12.984977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-856144818 could not be found. May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-856144818 could not be found. May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb708eef-0f6f-4499-9b3a-ff231d1b2093 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 404 to user: Volume tempest-invalid-856144818 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eb708eef-0f6f-4499-9b3a-ff231d1b2093 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-856144818" status: 404 len: 98 microversion: 2.1 time: 0.039773 May 10 20:22:12.986720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 370/723] 10.222.0.65 () {58 vars in 1214 bytes} [Tue May 10 20:22:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-856144818 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 20:22:12.990358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a17b01e3-a8b4-4717-a250-cab0f3ee9984 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003824 May 10 20:22:12.990858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 354/724] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 10 20:22:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 20:22:12.999581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ebc994ba-9621-4fda-8ee2-63c8a09c8eb6 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004195 May 10 20:22:13.000069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 371/725] 10.222.0.65 () {58 vars in 1136 bytes} [Tue May 10 20:22:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 20:22:13.007774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a711e51-4635-4413-9080-f6ba71cdd905 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Calling method '.version_select at 0x7f6028e74c10>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:13.034701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-5a711e51-4635-4413-9080-f6ba71cdd905 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] HTTP exception thrown: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a711e51-4635-4413-9080-f6ba71cdd905 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/os-volumes/6416708f-6ca6-487f-bbed-91d0b7e8453a HTTP/1.1 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:22:13.037937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '6416708f-6ca6-487f-bbed-91d0b7e8453a'} May 10 20:22:13.039536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. (HTTP 404) (Request-ID: req-226b2fb3-19d4-4bce-b2ce-1e5d2d7f5a15) May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.040506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:22:13.041961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:22:13.043936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a711e51-4635-4413-9080-f6ba71cdd905 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 404 to user: Volume 6416708f-6ca6-487f-bbed-91d0b7e8453a could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a711e51-4635-4413-9080-f6ba71cdd905 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/6416708f-6ca6-487f-bbed-91d0b7e8453a" status: 404 len: 109 microversion: 2.1 time: 0.035009 May 10 20:22:13.045222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 355/726] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:22:13 2022] DELETE /compute/v2.1/os-volumes/6416708f-6ca6-487f-bbed-91d0b7e8453a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:22:13.049549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bd35cc88-67d7-41aa-83a9-01b0abf4feb9 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Calling method '.version_select at 0x7f602910bdc0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:13.075071 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-bd35cc88-67d7-41aa-83a9-01b0abf4feb9 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] HTTP exception thrown: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bd35cc88-67d7-41aa-83a9-01b0abf4feb9 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Request method failure captured: May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/os-volumes/d0ea45cc-6921-42c0-8903-a8d495816d3b HTTP/1.1 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesl0_h_7ahtO_pC61VroKm_op25cpcA7fQfNPQD2scvsyRr7J3L0sU1mxtBzQmINg3aVCoXczJ1ItIIAzquw4GjIGmZuWLBz1kOMlq-sDKydw1FiqhqiQuiD46e6e03ks2Ao9-5d5xySCb3tpgQgPUHEJsbgVv_lFdAUr-8aCbXWIW4 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:22:13.076970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/735ffd0caa724744905c33edc9f0dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_735ffd0caa724744905c33edc9f0dd4e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 735ffd0caa724744905c33edc9f0dd4e May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-402157467 May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-402157467-project May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: ab1d5567f5fd46eeae07b57c25eef748 May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-402157467-project May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': 'd0ea45cc-6921-42c0-8903-a8d495816d3b'} May 10 20:22:13.078836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. (HTTP 404) (Request-ID: req-abefb5a4-d8ab-4a89-aef7-dcdb3f165a74) May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.079755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:22:13.080945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:22:13.082069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bd35cc88-67d7-41aa-83a9-01b0abf4feb9 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] Returning 404 to user: Volume d0ea45cc-6921-42c0-8903-a8d495816d3b could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bd35cc88-67d7-41aa-83a9-01b0abf4feb9 tempest-VolumesNegativeTest-402157467 tempest-VolumesNegativeTest-402157467-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d0ea45cc-6921-42c0-8903-a8d495816d3b" status: 404 len: 109 microversion: 2.1 time: 0.033023 May 10 20:22:13.083523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 372/727] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:22:13 2022] GET /compute/v2.1/os-volumes/d0ea45cc-6921-42c0-8903-a8d495816d3b => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:22:23.971947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:23.972564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:23.978733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:23.980275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:23.980275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:23.980981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:24.003706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e78f0c3b-1e46-48c9-bf87-5360c65852c0 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/ips" status: 200 len: 153 microversion: 2.20 time: 0.196713 May 10 20:22:24.004265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 356/728] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 10 20:22:23 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/ips => generated 153 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:22:26.432054 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:26.432592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:26.443724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:26.444233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:26.445022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:26.445497 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:26.472470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lazy-loading 'flavor' on Instance uuid 8b925038-2c3c-4a07-a98a-56c1df0786e5 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:22:27.061068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0c3cc89e-efd9-4531-b6e1-80bd7de0f330 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/action" status: 202 len: 0 microversion: 2.20 time: 0.634325 May 10 20:22:27.064280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 373/729] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 20:22:26 2022] POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:22:27.070103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:27.070735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:27.077370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:27.078124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:27.078895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:27.079330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:27.219317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:27.227061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:27.228575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:27.229762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e88f6a62-cd40-4f79-a1ef-97038e3b62e6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.163546 May 10 20:22:27.230377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 357/730] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:27 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:28.249138 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:28.250454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:28.256605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:28.257050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:28.257814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:28.258278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:28.393363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:28.401090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:28.402631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:28.404379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8cd4227-83cc-43bf-b930-53414f071911 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.160839 May 10 20:22:28.404937 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 374/731] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:28 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:29.423058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:29.423710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:29.430202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:29.430652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:29.431682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:29.431844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:29.565695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:29.573751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:29.575413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:29.576571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9c87efb-6a5e-421d-a4b1-2fafe5c5869c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.158130 May 10 20:22:29.577126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 358/732] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:29 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:30.594932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:30.595671 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:30.602010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:30.602488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:30.606834 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:30.606834 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:30.745677 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:30.753609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:30.755123 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:30.756275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cd357ba5-b23a-4e0f-9741-5c63bd984a6f tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.165535 May 10 20:22:30.756839 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 375/733] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:30 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:31.774878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:31.775497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:31.782426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:31.782879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:31.783662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:31.784102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:31.910789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:31.919974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:31.921496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:31.922832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-996328f0-6130-41b8-9585-42cba6ccbd0d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.151829 May 10 20:22:31.923556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 359/734] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:31 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:32.751660 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:32.752189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:32.758627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:32.759155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:32.759916 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:32.760343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:32.782998 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lazy-loading 'flavor' on Instance uuid 2ddf4267-70b6-417f-b6de-6873fb9117a4 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:22:32.940543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:32.941155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:32.947493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:32.947947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:32.948728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:32.949171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:33.051168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3608c31f-f045-4c12-bbec-a9637d76d67e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "POST /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4/action" status: 202 len: 0 microversion: 2.1 time: 0.303781 May 10 20:22:33.051791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 376/735] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:22:32 2022] POST /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:22:33.063540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:33.064378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:33.070789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:33.071177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:33.071967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:33.072411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:33.080631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:33.089198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:33.091480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:33.093847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5acf8d1b-9cbc-46ff-ad6e-f0ac216ca20e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.156230 May 10 20:22:33.093847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 360/736] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:32 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:33.216406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:33.223818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-82441691-1b43-4365-93b1-32acb389f1ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.166083 May 10 20:22:33.224390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 377/737] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:34.110932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:34.111535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:34.117827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:34.118312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:34.119081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:34.119512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:34.241340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:34.243132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:34.249896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:34.250524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:34.251391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:34.251890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:34.257702 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:34.260835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:34.262368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:34.264221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6d8ff23a-b1e0-4ef6-a99e-bc19312ece79 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.157160 May 10 20:22:34.265338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 361/738] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:34 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:34.383685 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:34.391173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-01d77ec3-3d8e-41b7-b8d3-d5e1aa3e8cb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.154276 May 10 20:22:34.391862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 378/739] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:35.282993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:35.283509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:35.289825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:35.290313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:35.291074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:35.291546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:35.409365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:35.409980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:35.416121 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:35.421015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:35.421159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:35.421288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:35.421288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:35.427972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:35.429482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:35.430696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9beb4807-fa96-4c08-91d0-14d73c80050a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.151742 May 10 20:22:35.431262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 362/740] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:35 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:35.550253 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:35.557512 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0597db92-42ba-4d60-aa69-5213cf9e5d79 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.151968 May 10 20:22:35.558076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 379/741] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:36.448898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:36.449648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:36.456707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:36.457277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:36.458254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:36.458694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:36.574931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:36.576627 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:36.583189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:36.583726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:36.584786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:36.585492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:36.601241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:36.611476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:36.614423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:36.616018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c96cf8b-89cb-41b9-a3e5-b26aa795db17 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.170910 May 10 20:22:36.616591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 363/742] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:36 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:36.717606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:36.725298 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8c5efa5-7b08-4b52-8834-3c578398519c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.154224 May 10 20:22:36.725873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 380/743] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:36.999410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:36.999903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:37.005947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.006434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.007211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.007652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.030826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4255be98-4c6c-4983-b359-a4295bb3a782 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/ips" status: 200 len: 144 microversion: 2.1 time: 0.035399 May 10 20:22:37.031396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 364/744] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:22:36 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:37.634744 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:37.635354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:37.642307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.642759 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.643533 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.643968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.742060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:37.742695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:37.749572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.750022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.750812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:37.751243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:37.784424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:37.792975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:37.794544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:37.795910 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5100d15a-e98f-4fdd-abd8-2b82b0e0b23b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.164912 May 10 20:22:37.796360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 381/745] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:37 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:37.890167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:37.898004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f8218e15-38e0-4d41-bb54-cab93cb5ecf2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.159722 May 10 20:22:37.899109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 365/746] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:38.651767 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e67dc6-1bf6-4496-9b93-7a0355b1b059"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:38.652977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:38.660087 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.660614 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:38.661469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.661963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:38.814449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:38.814971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:38.821358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.821840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:38.822644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.823083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:38.951537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:38.959861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:38.961385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:38.962604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b96853b7-8964-48d6-b7c9-e71da9f2bafc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.152353 May 10 20:22:38.963184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 366/747] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:38 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:22:38.968247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:38.969025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:38.975014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.975755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:38.976770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:38.977216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:39.108079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:39.115544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-042a5f43-4851-4645-84cf-b81de950f152 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.151373 May 10 20:22:39.116120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 367/748] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:38 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:39.396315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-066fa158-7f52-442b-8994-895db4df30e2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748394 May 10 20:22:39.396921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 382/749] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:22:38 2022] POST /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:39.981221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:39.981830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:39.987781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:39.988243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:39.988999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:39.989440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:40.119844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:40.128349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:40.129864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:40.131069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-47614ade-02f7-42ad-9b17-a44c1c1ab823 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.153708 May 10 20:22:40.131792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 368/750] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:39 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:40.134961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:40.135968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:40.146906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:40.147353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:40.148908 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:40.149353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:40.291252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:40.298625 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2c5fad64-bef0-478a-9067-e502b8e41d1e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.169333 May 10 20:22:40.299196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 383/751] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:41.149234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:41.149845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:41.156173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:41.156625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:41.157401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:41.157841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:41.288189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:41.296601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:41.298130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:41.299302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1bd9cc87-279b-4f31-83f1-e009a523f506 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.153939 May 10 20:22:41.299863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 369/752] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:41 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:41.316083 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:41.316699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:41.323016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:41.323467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:41.324238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:41.324709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:41.463655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:41.471474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-53ddaeb8-01f8-4bc5-9d52-5581dbbbc730 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.159160 May 10 20:22:41.472042 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 384/753] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:42.318596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:42.319138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:42.325452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:42.325900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:42.326733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:42.327176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:42.456815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:42.465198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:42.467003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:42.468174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfbf3f64-4640-4421-9ea1-1952ae0451b2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.153577 May 10 20:22:42.468741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 370/754] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:42 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:42.487859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:42.488471 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:42.495002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:42.495459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:42.496249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:42.496686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:42.642441 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:42.654186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-47de120c-9d27-4141-bb8f-c1c83500469c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.170039 May 10 20:22:42.654974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 385/755] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:43.490364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:43.490364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:43.495217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:43.495669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:43.496456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:43.497399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:43.629892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:43.637572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:43.639631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:43.640797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-49b18f4d-f334-42cb-ba8d-d27b2bc4e8d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1745 microversion: 2.20 time: 0.157314 May 10 20:22:43.641367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 371/756] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:43 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:43.676772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:43.677494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:43.685997 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:43.686494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:43.687360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:43.687778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:43.828982 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:43.836489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5c07bb7c-0e9a-4247-b2c9-be592e1f5a30 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.165527 May 10 20:22:43.837068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 386/757] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:44.659037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:44.660139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:44.666657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:44.667138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:44.667924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:44.668358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:44.840841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:44.852538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:44.854557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:44.855599 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:44.856417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:44.857165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-42305ac6-9f33-4ad5-9cfc-d8e21e9d77be tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.200768 May 10 20:22:44.858231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 372/758] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:44 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:44.864216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:44.864755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:44.865668 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:44.866114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:45.006339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:45.014550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-17b8d6f3-15fe-4d3f-962e-358542232ac2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.163540 May 10 20:22:45.015065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 387/759] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:45.881578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:45.882968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:45.889471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:45.889873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:45.890918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:45.891552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:46.032114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:46.032770 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:46.041469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:46.042886 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:46.043875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:46.044786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:46.058206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:46.068630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:46.070306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:46.071895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-daf5861d-1097-401e-88a2-a6e1d8d61a4c tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.195275 May 10 20:22:46.073187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 373/760] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:45 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:46.239355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:46.247278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5440faa8-4f9b-4784-9b3a-003d134c7cf0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.219334 May 10 20:22:46.248184 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 388/761] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:46.656734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-a81e630e-6750-4026-a8e4-e1fb6741f69f req-a9833173-bc81-495f-893f-32bbf9261a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "name": "network-vif-plugged", "status": "completed", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:46.670525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a81e630e-6750-4026-a8e4-e1fb6741f69f req-a9833173-bc81-495f-893f-32bbf9261a9f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:46.671072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a81e630e-6750-4026-a8e4-e1fb6741f69f req-a9833173-bc81-495f-893f-32bbf9261a9f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:46.686154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-a81e630e-6750-4026-a8e4-e1fb6741f69f req-a9833173-bc81-495f-893f-32bbf9261a9f service nova] Creating event network-vif-plugged:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:22:46.691902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-a81e630e-6750-4026-a8e4-e1fb6741f69f req-a9833173-bc81-495f-893f-32bbf9261a9f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223114 May 10 20:22:46.697960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 374/762] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:46.981010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:46.982304 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:46.988599 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:46.989166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:46.990169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:46.990814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.025654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8304a7fc-44ec-4e7e-b4ff-225ce1f1d79d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048713 May 10 20:22:47.026438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 389/763] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:22:46 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:47.037947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:47.039136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:47.049509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.049974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.050828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.051275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.088782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8805e595-b1b7-4a63-8d2a-63764b7587c2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059" status: 200 len: 194 microversion: 2.1 time: 0.055457 May 10 20:22:47.089928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 375/764] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 20:22:47 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:47.098894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:47.099530 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:47.114564 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.116014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.117941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.118416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.267831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:47.268537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:47.274768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.275228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.276017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:47.286588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:47.301647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:47.310447 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:47.315718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:47.315718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-651dd689-6bc9-49d3-9097-7654ed3c5d90 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.224549 May 10 20:22:47.315718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 390/765] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:47 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:22:47.457381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:47.465545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85fdc3e9-bf17-4612-9061-e1818824cd83 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.204517 May 10 20:22:47.467642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 376/766] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:48.337287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:48.338630 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:48.358624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.359089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:48.359895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.360554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:48.485601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:48.486445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:48.493605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.493605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:48.494492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.495028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:48.514422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:48.524847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:48.526998 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:48.528334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0c0d673a-db6d-40e3-93f4-ce24cdc82057 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.195114 May 10 20:22:48.529616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 391/767] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:48 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:48.691840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:48.699838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f5b320c6-1679-4633-9676-379726dde054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.219723 May 10 20:22:48.702386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 377/768] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:48.824225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc9af8a8-56f7-44fe-8a77-71691dd37595"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:48.826035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:48.832239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.832689 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:48.835371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:48.835371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:49.549532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:49.550774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:49.558430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:49.560917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:49.561915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:49.562555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:49.812706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:49.826796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:49.830171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:49.831464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0f5589de-15e0-4fe7-bf26-205ba04bcfe4 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.286099 May 10 20:22:49.832564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 378/769] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:49 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:22:49.837512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:49.838639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:49.846945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:49.848030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:49.849536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:49.850353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:50.000253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:50.008475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d47c8e7-f990-42e8-b4e4-0cd0a3845bf9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.174711 May 10 20:22:50.009338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 379/770] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:50.853041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:50.854183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:50.861761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:50.862569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:50.863578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:50.864219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:50.970334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c3050705-dc0f-4aae-88f3-b64a7c5642a8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "POST /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.150042 May 10 20:22:50.976374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 392/771] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:22:48 2022] POST /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 194 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:22:51.011484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:51.030175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:51.034386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:51.037179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:51.040235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:51.041774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e54f1de7-4fc0-4b0c-b671-660805c41352 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.193037 May 10 20:22:51.042541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 380/772] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:50 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:22:51.046185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:51.046682 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:51.047502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:51.050547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:51.243353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:51.256274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b760f0c8-4bc1-4182-af06-71898af806f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.231734 May 10 20:22:51.257003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 393/773] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:22:52.060998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:52.061630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:52.068036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.068481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.069247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.069682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.213397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:52.221827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:52.223385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:52.224551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-616138d7-a384-4382-aa8e-e1c7bddbf240 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.168053 May 10 20:22:52.225841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 381/774] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:52 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:52.274145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:52.274885 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:52.281374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.289326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.289326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.289326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.428744 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:52.437902 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-632ada72-2219-4715-9c5f-b58b3bc8501a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1510 microversion: 2.1 time: 0.167553 May 10 20:22:52.438563 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 394/775] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:52.456046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:52.456668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:52.462873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.463528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.464442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.465045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.812300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e987457-31fb-45a9-8957-238d73b524f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "POST /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4/action" status: 202 len: 0 microversion: 2.1 time: 0.361795 May 10 20:22:52.813224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 382/776] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 20:22:52 2022] POST /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:22:52.821915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:52.825064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:52.838165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.838624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:52.839585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:52.843327 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:53.047824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:53.055791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e5516214-fb01-4053-b243-55d790c64cd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1518 microversion: 2.1 time: 0.238291 May 10 20:22:53.059080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 395/777] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:53.243632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:53.244325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:53.251938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:53.252689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:53.253699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:53.254404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:53.475962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:53.485498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:53.487041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:53.488472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e67ddcb2-35b4-43a8-bccc-1e850eee552e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.248738 May 10 20:22:53.489229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 383/778] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:53 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:54.077008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:54.077601 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:54.098376 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:54.098958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:54.099769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:54.100229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:54.285503 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:54.297314 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e5fc16dd-352a-4f3d-832d-bcc034019856 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.224670 May 10 20:22:54.297915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 396/779] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:54.437688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-97901f24-8090-485c-856a-9b6974238faf req-b189bc6f-bdb0-48e7-93ac-6915332a3442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "name": "network-vif-unplugged", "status": "completed", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:22:54.446620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-97901f24-8090-485c-856a-9b6974238faf req-b189bc6f-bdb0-48e7-93ac-6915332a3442 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:54.447752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-97901f24-8090-485c-856a-9b6974238faf req-b189bc6f-bdb0-48e7-93ac-6915332a3442 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:54.460206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.compute.server_external_events [req-97901f24-8090-485c-856a-9b6974238faf req-b189bc6f-bdb0-48e7-93ac-6915332a3442 service nova] Unable to find a host for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4. Dropping event network-vif-unplugged {{(pid=117754) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 20:22:54.461546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-97901f24-8090-485c-856a-9b6974238faf req-b189bc6f-bdb0-48e7-93ac-6915332a3442 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028049 May 10 20:22:54.462639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 384/780] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 20:22:54.507086 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:54.508074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:54.515523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:54.516007 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:54.516797 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:54.517238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:54.676103 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:54.686607 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:54.688722 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:54.690221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa0558c6-eaca-4b31-8c39-9bef93643d5b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.187245 May 10 20:22:54.691314 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 397/781] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:54 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:22:55.315811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:55.316416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:55.322447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:55.322871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:55.327443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:55.327882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:55.461730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:55.471069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e002cae3-89cb-42b2-8061-a82def42d1b2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.158975 May 10 20:22:55.471811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 385/782] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:55.719049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:55.719590 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:55.726003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:55.726488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:55.727263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:55.727708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:55.854753 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:55.863134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:55.864624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:55.865776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1e27437a-2642-4ab7-9af5-b04ce878ed41 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.151381 May 10 20:22:55.866374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 398/783] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:55 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:56.489703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:56.490433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:56.497620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:56.501688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:56.501688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:56.501688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:56.633159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:56.641133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-06819801-c62d-4713-9448-83c435d29725 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.155760 May 10 20:22:56.641696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 386/784] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:56.884845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:56.885323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:56.891889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:56.892347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:56.893132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:56.893575 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:57.034263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:57.043863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:57.045586 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:57.049354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e27b3048-23a1-432c-8e6f-15235c850f84 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1740 microversion: 2.20 time: 0.169070 May 10 20:22:57.049858 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 399/785] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:56 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:57.657419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:57.658121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:57.665109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:57.665534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:57.666350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:57.666784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:57.805607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:57.814992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6cf1acf0-0733-4b3a-9f70-70400eba9321 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.161296 May 10 20:22:57.815494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 387/786] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:58.067488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:58.068076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:58.074484 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:58.076366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:58.076366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:58.076366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:58.204024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:58.211611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:58.213095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:58.214269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-251f096a-b4e4-4b19-8880-25056d8b868d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1722 microversion: 2.20 time: 0.150861 May 10 20:22:58.214898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 400/787] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:58 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:58.832841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:58.833567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:58.839925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:58.849806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:58.849806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:58.849806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:58.982222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:58.989508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6ab3c5b-1ed0-4615-bf25-11e9c7a13510 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.160749 May 10 20:22:58.990107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 388/788] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:22:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:22:59.233346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:59.233961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:59.240022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.242895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.242895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.242895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.382296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:59.390270 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:59.391754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:22:59.392903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-88799a8f-01d9-4a52-88c0-f8eb891cbdae tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1722 microversion: 2.20 time: 0.164152 May 10 20:22:59.393467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 401/789] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:22:59 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:22:59.754212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:59.755141 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:59.760939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.762269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.762269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.762582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.791547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-62623a31-4710-4c50-9ef0-f4206e273ed8 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041286 May 10 20:22:59.793449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 389/790] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:22:59 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:59.932377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:59.932871 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:59.939341 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.939793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.940558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.940991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.969348 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5331f081-f4c6-4fd1-a902-50d9d1d37809 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059" status: 200 len: 194 microversion: 2.1 time: 0.040921 May 10 20:22:59.969935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 402/791] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 20:22:59 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:22:59.979478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:22:59.980009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:22:59.987277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.987733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:22:59.988511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:22:59.988979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.006841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:00.007526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:00.013859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:00.014290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.015105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:00.015546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.071817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lazy-loading 'services' on Instance uuid 6eee18d5-fa67-4cab-b9ce-a94bf66579fb {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:00.157218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:00.165319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4e020dac-e118-4d11-8d46-60af5ade0ca6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1520 microversion: 2.1 time: 0.162054 May 10 20:23:00.175133 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 403/792] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:00.335777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f922678e-df0e-464f-808f-34f104db8ad2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059" status: 202 len: 0 microversion: 2.1 time: 0.359989 May 10 20:23:00.336474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 390/793] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:22:59 2022] DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/89e67dc6-1bf6-4496-9b93-7a0355b1b059 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:23:00.412179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:00.412954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:00.422776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-35dc0fc7-2a18-4f04-b8b6-682e63215c70 req-4ceb25de-78fd-41b5-b537-003f0abce42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "name": "network-vif-unplugged", "status": "completed", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:00.433706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:00.434191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.435020 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:00.435459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.441203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-35dc0fc7-2a18-4f04-b8b6-682e63215c70 req-4ceb25de-78fd-41b5-b537-003f0abce42f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:00.449896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-35dc0fc7-2a18-4f04-b8b6-682e63215c70 req-4ceb25de-78fd-41b5-b537-003f0abce42f service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:00.455850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-35dc0fc7-2a18-4f04-b8b6-682e63215c70 req-4ceb25de-78fd-41b5-b537-003f0abce42f service nova] Creating event network-vif-unplugged:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:23:00.460522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-35dc0fc7-2a18-4f04-b8b6-682e63215c70 req-4ceb25de-78fd-41b5-b537-003f0abce42f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042286 May 10 20:23:00.461321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 391/794] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:00.626884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:00.634954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:00.636540 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:00.637717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5ac836ed-6fce-4b04-95c1-91902e25d8c8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1722 microversion: 2.20 time: 0.229723 May 10 20:23:00.638857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 404/795] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:00 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:01.183610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:01.184333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:01.191108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.191549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:01.192309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.192741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:01.336466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:01.344074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b01efd3-a668-4c7d-bf12-1f596eac30fe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.165038 May 10 20:23:01.353387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 392/796] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:01.656565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:01.657175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:01.663444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.663888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:01.664857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.665293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:01.836170 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:01.844542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:01.846026 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:01.847214 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b9cec773-2cea-48dc-a196-cf24fb9b1455 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1665 microversion: 2.20 time: 0.195243 May 10 20:23:01.847792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 405/797] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:01 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1665 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:01.868291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45263f04-e2ac-4eef-8836-c411a8f679b6"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:01.869401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:01.875899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.876263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:01.877070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:01.877515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.361015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:02.361646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:02.367479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.367927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.368686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.369117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.505837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:02.513386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-078fd91f-6603-4391-bb9c-702bee466e1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.156370 May 10 20:23:02.515173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 406/798] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:02.526867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:02.526867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:02.526867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.526867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.527172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.527172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.556313 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e987ef3c-e175-43b8-84f1-0946b3f1bf00 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/fc9af8a8-56f7-44fe-8a77-71691dd37595" status: 200 len: 194 microversion: 2.1 time: 0.041040 May 10 20:23:02.557065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 407/799] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 20:23:02 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/fc9af8a8-56f7-44fe-8a77-71691dd37595 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:02.566641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:02.567133 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:02.572738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.573195 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.573963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:02.574487 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:02.666110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lazy-loading 'services' on Instance uuid 6eee18d5-fa67-4cab-b9ce-a94bf66579fb {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:02.924622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ee9d1469-d546-4321-851b-bcca58f3fa94 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/fc9af8a8-56f7-44fe-8a77-71691dd37595" status: 202 len: 0 microversion: 2.1 time: 0.361551 May 10 20:23:02.925398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 408/800] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:23:02 2022] DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments/fc9af8a8-56f7-44fe-8a77-71691dd37595 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:23:02.999375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9a7836a-a4ff-47ac-8861-44b5d00e54eb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.135081 May 10 20:23:02.999996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 393/801] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 10 20:23:01 2022] POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments => generated 188 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:23:03.115434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:03.116015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:03.122554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.123063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:03.123801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.124239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:03.535840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:03.536454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:03.543645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.544086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:03.545453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.549972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:03.695848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:03.703956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d55b302f-b8b8-4142-bfa2-af5b34ab8af9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.171753 May 10 20:23:03.704718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 394/802] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:03.741628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9e5c6c91-a45e-4e50-9914-04bf0771a336 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments/45263f04-e2ac-4eef-8836-c411a8f679b6" status: 202 len: 0 microversion: 2.20 time: 0.630471 May 10 20:23:03.742265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 409/803] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 10 20:23:03 2022] DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments/45263f04-e2ac-4eef-8836-c411a8f679b6 => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:23:03.798620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:03.799199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:03.805526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.805961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:03.806841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:03.807279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.063212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db587fe9-bf4f-4eb5-90e2-fc97d37e6df2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/action" status: 202 len: 0 microversion: 2.20 time: 0.264653 May 10 20:23:04.063212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 395/804] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 20:23:03 2022] POST /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:23:04.068569 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.069218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.076851 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.077606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.078597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.079289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.100331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.101463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.107926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.108513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.109409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.144426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-40ef938f-4568-4778-9a7b-8851eceb845a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047994 May 10 20:23:04.145566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 396/805] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:23:04.249154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:04.257849 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:04.259578 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:04.260947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2f283354-80b9-4b09-ad1d-60d3e77d10fc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1673 microversion: 2.20 time: 0.196477 May 10 20:23:04.261675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 410/806] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:04.281068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.283273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.289560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.290270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.291303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.291899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.342717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-47b5b78f-07c1-4d25-b4dd-71e812ce4abb tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065418 May 10 20:23:04.343906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 397/807] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:23:04.407441 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.408333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.417773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.419155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.420292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.421478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.460652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.465056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.465196 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:23:04.476011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.476471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.477263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.477967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.509807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:23:04.760449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0daabeeb-3dcf-46ce-9cc4-19507f0f2ff2 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 204 len: 0 microversion: 2.1 time: 0.356761 May 10 20:23:04.761803 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 411/808] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:23:04 2022] DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:23:04.769492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.770495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.777197 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.777705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.778604 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.779554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.845473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-198852d2-9185-4a83-abd1-8bf9e5eeacde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 204 len: 0 microversion: 2.1 time: 0.388890 May 10 20:23:04.846070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 398/809] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:23:04 2022] DELETE /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:23:04.852212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.853222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.860013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.860711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.861737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.862414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.964972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:04.972622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7d88f068-7762-4518-ad27-c5bfd6abdfb7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.209175 May 10 20:23:04.974708 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 412/810] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:04.980281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:04.981146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:04.993843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.994711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:04.995594 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:04.996141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:05.071057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:05.079889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7fc1e057-1f67-4043-8ed6-2e75c3c1d556 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1671 microversion: 2.1 time: 0.232318 May 10 20:23:05.080477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 399/811] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:05.189115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:05.196543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-78a3a6a3-fbfd-41d2-a3fa-371d9e7dc308 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1577 microversion: 2.1 time: 0.220597 May 10 20:23:05.197117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 413/812] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:04 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:05.281069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:05.281671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:05.289086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:05.289800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:05.290799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:05.291402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:05.421371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:05.429465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:05.430991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:05.432196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-183c871c-5aba-4ff2-beef-64401b4773c1 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1673 microversion: 2.20 time: 0.156040 May 10 20:23:05.432766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 400/813] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:05 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:05.989751 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:05.990421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:05.996845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:05.997298 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:05.998675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:05.999115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.099017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:06.099629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:06.106315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.107516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.108500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.108939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.133800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.141554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3265b9d7-b504-4274-90ca-cbf96867d088 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.155618 May 10 20:23:06.151699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 414/814] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:06.214332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:06.215090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:06.221501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.221957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.222773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.223218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.244651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.252866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-98101daf-ad71-46be-b1c1-54a85afb728b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1671 microversion: 2.1 time: 0.158183 May 10 20:23:06.254289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 401/815] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:06 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:06.356651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.364064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8e71fe82-e661-4f17-92e0-00cc90090f41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1577 microversion: 2.1 time: 0.153723 May 10 20:23:06.364634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 415/816] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:06 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:06.450267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:06.451516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:06.458772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.459222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.460056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:06.460494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:06.587642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.595950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.597451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:06.598635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f4a23725-fb9f-4c9f-953e-d40c379407bb tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1675 microversion: 2.20 time: 0.152306 May 10 20:23:06.599197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 402/817] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:06 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:06.940859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1963434234", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "networks": [{"uuid": "8750fcec-68a3-4030-8b36-de70cc9667b1"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:06.990312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] validate_networks() for [('8750fcec-68a3-4030-8b36-de70cc9667b1', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:23:07.159501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:07.160119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:07.166428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.166883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.167656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.168096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.306662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:07.314769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6bbd8239-cc02-450c-97be-a9801f623f89 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.159346 May 10 20:23:07.324282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 403/818] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:07 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:07.329829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:07.330110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:07.337179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.337179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.338108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.339019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.383429 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:23:07.383843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:23:07.384347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:23:07.384758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:23:07.385178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:23:07.394598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.395046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.395853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.396288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.412742 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Getting quotas for project 498ce5260ee44f5d9b1ebc74fecedfbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:23:07.416758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Getting quotas for user 77e46909519247119a6bc011b6bcfc7c and project 498ce5260ee44f5d9b1ebc74fecedfbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:23:07.438324 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:23:07.440730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:23:07.548207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:07.552215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1186ac86-2fd1-4ad9-a76f-67c384bd6002 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1671 microversion: 2.1 time: 0.235739 May 10 20:23:07.552793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 404/819] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:07 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:07.557292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:07.557898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:07.564510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.564950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.565714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.566303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.580416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [69d0c199-b46b-4a24-afce-b5a3fa51fb1c] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 20:23:07.812335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:07.820599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b2e0f116-2fe5-484a-a4fb-d80315e2131b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1577 microversion: 2.1 time: 0.266831 May 10 20:23:07.821318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 405/820] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:07 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:07.829263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:07.830355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:07.838220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.838688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:07.840152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:07.840406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.101106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.109363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.110889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.112052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-903fbe65-e68d-483c-ad59-10d3323067a8 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.289380 May 10 20:23:08.112808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 406/821] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:07 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:08.333303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:08.334049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:08.340481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.340931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.342312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.342751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.592740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [69d0c199-b46b-4a24-afce-b5a3fa51fb1c] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 42770. May 10 20:23:08.597716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4ef00875-ba25-41b4-8a62-46197711856f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660675 May 10 20:23:08.598763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 416/822] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:23:08.606523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:08.607309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:08.615560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.616013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.616791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.617224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.672295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.679696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-337faff5-3ef8-424d-98bb-7e51a477f224 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.350925 May 10 20:23:08.680529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 407/823] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:08.685712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-336efdaf-b6fe-4cef-bff9-f813078077aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:08.686709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-336efdaf-b6fe-4cef-bff9-f813078077aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:08.767131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-336efdaf-b6fe-4cef-bff9-f813078077aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.768971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:08.773965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-336efdaf-b6fe-4cef-bff9-f813078077aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1219 microversion: 2.1 time: 0.092262 May 10 20:23:08.774599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 408/824] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:08 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:08.783981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-396e5f24-d1ad-49dc-8268-690eca807c0b tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1604 microversion: 2.1 time: 0.178341 May 10 20:23:08.783981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 417/825] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:08 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:08.849444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:08.850495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:08.857643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.858119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:08.859117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:08.859583 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.040422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-decce2a6-bfbf-4f74-b4f8-0793440ef394 req-457486f3-be13-4b55-a3ba-721ac2515749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eee18d5-fa67-4cab-b9ce-a94bf66579fb", "name": "network-vif-deleted", "tag": "1ffedcb9-4d80-458b-b618-d76c58afd63f"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:09.048602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-decce2a6-bfbf-4f74-b4f8-0793440ef394 req-457486f3-be13-4b55-a3ba-721ac2515749 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.049094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-decce2a6-bfbf-4f74-b4f8-0793440ef394 req-457486f3-be13-4b55-a3ba-721ac2515749 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.060435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.061917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-decce2a6-bfbf-4f74-b4f8-0793440ef394 req-457486f3-be13-4b55-a3ba-721ac2515749 service nova] Creating event network-vif-deleted:1ffedcb9-4d80-458b-b618-d76c58afd63f for instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb on hv-cinder-82880 May 10 20:23:09.067521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-decce2a6-bfbf-4f74-b4f8-0793440ef394 req-457486f3-be13-4b55-a3ba-721ac2515749 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 May 10 20:23:09.068766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 409/826] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:23:09.071873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a92e650d-1dc1-4e19-8ba2-97e9a38cba89 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1577 microversion: 2.1 time: 0.235444 May 10 20:23:09.074010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 418/827] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:08 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:09.132513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:09.133220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:09.143590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.144723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.146610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.147110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.444864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.454676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.456299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.457847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5d393a77-819e-43c7-9a20-576762d4416a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.331179 May 10 20:23:09.465715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 410/828] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:09 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:09.702579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:09.704226 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:09.711467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.712102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.712877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.713464 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.795569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:09.796228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:09.810550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.812296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.814662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.815262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.888772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.895616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cf75afbc-1514-4a60-be25-4ccbd3309a0c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.202374 May 10 20:23:09.898362 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 419/829] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:09 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:09.903545 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:09.904868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:09.921558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:09.931148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96867ffe-389a-478d-aacd-dd876d9d7b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1223 microversion: 2.1 time: 0.143538 May 10 20:23:09.932343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 411/830] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:09 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1223 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:09.947852 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.949211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.951213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.952510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.990307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:09.991013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:09.992273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lazy-loading 'fault' on Instance uuid 6eee18d5-fa67-4cab-b9ce-a94bf66579fb {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:10.053445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e69662bc7648b8b3e7467cf56c7f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821dc2c3061041a3ab6ee939c306a7ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:10.064551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bde5cad2-0c81-47cc-a353-dcb32400ab41 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 200 len: 1327 microversion: 2.1 time: 0.164704 May 10 20:23:10.065518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 420/831] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:09 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:10.093946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:10.094703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:10.107543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.113912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.116693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.117270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.204460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:10.218340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-968f13dc-8500-4aab-b397-46ca9b8c5fcb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1225 microversion: 2.1 time: 0.129467 May 10 20:23:10.230364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 412/832] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:10 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:10.476147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:10.477310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:10.491123 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.491997 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.493058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.493716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.720961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:10.733976 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:10.735542 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:10.736787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a4cf54d-0406-41f5-ae3b-73089e1ae9c6 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.264553 May 10 20:23:10.755204 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 421/833] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:10 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:10.916854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:10.917491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:10.940366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.941101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.941904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.944058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.949581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:10.950574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:10.959299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.961100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:10.963003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:10.965102 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.117076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:11.125478 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-949aaab5-8fa7-4202-b6df-f39fe2fcd71d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.180443 May 10 20:23:11.126623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 422/834] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:10 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:11.131273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:11.132101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:11.147608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.148063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.149416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.149870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.172778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb HTTP/1.1 May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:23:11.180215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:11.181943 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '6eee18d5-fa67-4cab-b9ce-a94bf66579fb'} May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:11.182894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:11.184491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:11.186474 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:11.187146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4aa3cad3-5c03-42b7-9a9f-a984be4ff965 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 404 len: 111 microversion: 2.1 time: 0.059547 May 10 20:23:11.191391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 423/835] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:11 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:11.205893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-46b71f2a-b454-4dd2-8d4d-eafaebd4e496 req-68c823ef-ceb1-47cf-a402-a5885bef5163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c1d58-2493-43f6-b011-90a3bac5ac0d", "name": "network-vif-deleted", "tag": "f51a35ef-40a9-4291-8e5d-3689f54d025d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:11.210329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:11.218923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fcf6f71a-b027-4964-9139-2268f6cf6da3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.307531 May 10 20:23:11.221400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 413/836] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:11.226591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-916fcb3e-6945-46f4-935e-8099b1095966 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '.version_select at 0x7f6028e69940>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:11.241645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-46b71f2a-b454-4dd2-8d4d-eafaebd4e496 req-68c823ef-ceb1-47cf-a402-a5885bef5163 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.242287 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-46b71f2a-b454-4dd2-8d4d-eafaebd4e496 req-68c823ef-ceb1-47cf-a402-a5885bef5163 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.256412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-46b71f2a-b454-4dd2-8d4d-eafaebd4e496 req-68c823ef-ceb1-47cf-a402-a5885bef5163 service nova] Creating event network-vif-deleted:f51a35ef-40a9-4291-8e5d-3689f54d025d for instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d on hv-cinder-82880 May 10 20:23:11.262339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-46b71f2a-b454-4dd2-8d4d-eafaebd4e496 req-68c823ef-ceb1-47cf-a402-a5885bef5163 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069397 May 10 20:23:11.263447 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 424/837] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:11.269642 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:11.270496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:11.277687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.278208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.279139 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.279684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.314671 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.315323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.315810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:11.337909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-916fcb3e-6945-46f4-935e-8099b1095966 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874849454" status: 202 len: 0 microversion: 2.1 time: 0.114883 May 10 20:23:11.344675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 414/838] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 20:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874849454 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:23:11.373131 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:11.391150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-95d266da-2e9b-4625-8830-b41e66f215df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.125391 May 10 20:23:11.391150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 425/839] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:11 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:11.762419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:11.764068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:11.771036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.771871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:11.773210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:11.773884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.142743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:12.143968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:12.154142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.156295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.157296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.159985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.233007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.241734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.243317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.244546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5877ce46-b420-4d05-bc93-a49f7f0b3b81 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.486398 May 10 20:23:12.245744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 415/840] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:11 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:12.251496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:12.252710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:12.260033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.260475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.261254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.261684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.287338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.296469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b086bcbe-6c5b-43c6-afe1-5c75b13a9265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.157892 May 10 20:23:12.306337 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 426/841] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:12 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:12.410065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:12.410714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:12.417137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.417597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.418421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.418863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.447240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.457234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7edb39c4-0b14-4c43-9c32-bf80899e78f8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.210067 May 10 20:23:12.465365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 416/842] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:12.482737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.483429 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.483991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:12.591624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-0af89bb2-16a2-4602-9152-3decd1c18bb0 req-89b3e24b-e7ba-424b-af80-f4cf10c26b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "name": "network-vif-plugged", "status": "completed", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:12.602473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0af89bb2-16a2-4602-9152-3decd1c18bb0 req-89b3e24b-e7ba-424b-af80-f4cf10c26b2c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:12.603686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0af89bb2-16a2-4602-9152-3decd1c18bb0 req-89b3e24b-e7ba-424b-af80-f4cf10c26b2c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:12.619344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:12.634508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-0af89bb2-16a2-4602-9152-3decd1c18bb0 req-89b3e24b-e7ba-424b-af80-f4cf10c26b2c service nova] Creating event network-vif-plugged:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:23:12.635561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db543bbc-75d3-4e7e-a58e-78be49477e13 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.229811 May 10 20:23:12.639897 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 427/843] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:12 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:12.649444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-0af89bb2-16a2-4602-9152-3decd1c18bb0 req-89b3e24b-e7ba-424b-af80-f4cf10c26b2c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064244 May 10 20:23:12.650583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 417/844] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:23:13.264935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:13.265549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:13.271972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.272448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.273213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.273844 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.316031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:13.317414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:13.324215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.325106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.326810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.327509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.400735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.409339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ebb99dd8-ffc9-419a-a0f8-e374456cc6bd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.099885 May 10 20:23:13.412797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 418/845] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:13 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:13.436697 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.446248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.447834 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.449067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8de4101-885c-423f-9297-fc37bfc66f40 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.189596 May 10 20:23:13.449984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 428/846] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:13 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:13.483144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:13.483828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:13.490591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.491046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.492187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.492626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.637259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.645442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-215e639c-a11d-419b-9236-83d3da1afffe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.166746 May 10 20:23:13.655633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 419/847] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:13 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:13.655824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:13.656401 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:13.662622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.667795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.667795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.667795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.699302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:13.699763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:13.700217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:13.743479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:13.751363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7eeb078f-0d3f-4f55-a453-c8d4b48cc1b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.099728 May 10 20:23:13.751930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 429/848] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:13 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:14.427411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:14.428014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:14.434706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.435765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.436584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.436998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.490134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:14.490134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:14.490134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.490134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.491044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.491044 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.517093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.527629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a79aee51-8fa7-4965-bba1-b5ed85e5440b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.104194 May 10 20:23:14.538861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 420/849] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:14 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:14.657168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.662482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:14.665234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:14.672328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.672810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.673627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.674102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.674420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.675903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.677050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa45f45b-329e-4a28-8674-615028bfadec tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.213044 May 10 20:23:14.677609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 430/850] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:14 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:14.767932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:14.768612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:14.775705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.777764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.777764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.777764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.819893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:14.820517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:14.821277 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:14.850067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.864568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-03ce43fb-93f3-4a67-85bf-f000fc304afa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.205666 May 10 20:23:14.865823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 421/851] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:14.880064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:14.891073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5c01b132-8118-4715-81cc-9af702a0f6dd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.127517 May 10 20:23:14.892048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 431/852] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:14 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:15.271090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.271597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.277466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.277916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.278731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.279170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.456526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb HTTP/1.1 May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:23:15.458249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.459718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '6eee18d5-fa67-4cab-b9ce-a94bf66579fb'} May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:15.460480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.461807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:15.463089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:15.463089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e1ae4a2f-8fad-450b-9e0f-253225ae7139 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 404 len: 111 microversion: 2.1 time: 0.192517 May 10 20:23:15.463089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 422/853] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:23:15 2022] DELETE /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:15.469250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.469905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 6eee18d5-fa67-4cab-b9ce-a94bf66579fb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.477161 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.477756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.478740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.479257 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.545808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.546602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.561210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.561764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.562688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.563134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.631403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:15.644978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9bdd51c2-fb8c-4f9b-8366-97fbba74b660 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.103721 May 10 20:23:15.646867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 423/854] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:15 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:15.662972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb HTTP/1.1 May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:23:15.664747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.666381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '6eee18d5-fa67-4cab-b9ce-a94bf66579fb'} May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:15.670407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. May 10 20:23:15.672853 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:15.674779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 6eee18d5-fa67-4cab-b9ce-a94bf66579fb could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:15.674779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-074a6d3f-035b-4701-80af-eab799d62299 tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb" status: 404 len: 111 microversion: 2.1 time: 0.201446 May 10 20:23:15.674779 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 432/855] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:15 2022] GET /compute/v2.1/servers/6eee18d5-fa67-4cab-b9ce-a94bf66579fb => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:15.704327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.704327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.704327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.704327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.704665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.704745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.844025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:15.853396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:15.855142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:15.856356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-76e270f3-ff25-4f20-9d82-5cb37640b797 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.164747 May 10 20:23:15.866230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 424/856] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:15 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:15.882964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.883991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.891155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.891607 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.892390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.892855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.910443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:15.911293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:15.917748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.918545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.920350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.929758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.975392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:15.975840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:15.976297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:16.031087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:16.039567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96d8aaf6-8dae-4af4-b337-6f86dbaef56f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.134129 May 10 20:23:16.040512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 425/857] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:15 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:16.073256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:16.082034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-531f125f-cb1b-4073-8ce5-9258e5fe4afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.203585 May 10 20:23:16.082625 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 433/858] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:15 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:16.662843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:16.663608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:16.671119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:16.671566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:16.672374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:16.672809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:16.767275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:16.773399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-03210f0b-b8a1-48d2-a1bf-a9bc345cd582 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.114372 May 10 20:23:16.782522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 426/859] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:16 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:16.877623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:16.879405 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:16.886207 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:16.886949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:16.887920 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:16.889220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.027092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:17.027883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:17.034107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.035544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.036422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.036869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.065317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.073162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.073734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc HTTP/1.1 May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:23:17.075019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.077307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '25f6cc79-11c0-4244-ac21-ac182db7d7cc'} May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:17.078300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.080174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:17.081713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:17.082386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df38ab43-9540-4e7c-b9a8-52412e6c272d tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 404 len: 111 microversion: 2.1 time: 0.059221 May 10 20:23:17.083401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 427/860] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:23:17 2022] DELETE /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:17.084386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.085617 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-78112c98-7d7c-40af-b42a-7f98997d9e73 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.212664 May 10 20:23:17.086283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 434/861] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:16 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:17.090716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:17.091366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] [instance: 25f6cc79-11c0-4244-ac21-ac182db7d7cc] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:17.102506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:17.102894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.103367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.104508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:17.104643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.104643 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.116255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.120103 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] HTTP exception thrown: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Request method failure captured: May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc HTTP/1.1 May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg2UScv7YFAgwNyjKz6sLsUVGyUW9XauZnnSO3WT15shKsF5Z99U9yRfbLEUKvLSo8RuHwp0v3suZZDgvK4poP8jA1UkXJXDuORQWK9XGqm2ukSjsjF3r6u4ATz29XVTHavFnx31Cc7RNZnzoiwTApFCd_wv8MWwBLxGm56RzgBYTU May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:23:17.121764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/821dc2c3061041a3ab6ee939c306a7ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_821dc2c3061041a3ab6ee939c306a7ea", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 821dc2c3061041a3ab6ee939c306a7ea May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966860934 May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 35e69662bc7648b8b3e7467cf56c7f5e May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1966860934-project May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.124470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '25f6cc79-11c0-4244-ac21-ac182db7d7cc'} May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:17.126758 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. May 10 20:23:17.129895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:23:17.131450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] Returning 404 to user: Instance 25f6cc79-11c0-4244-ac21-ac182db7d7cc could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:17.131450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-49707650-4cb8-4822-a379-892daf47b71a tempest-AttachVolumeTestJSON-1966860934 tempest-AttachVolumeTestJSON-1966860934-project] 10.222.0.65 "GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc" status: 404 len: 111 microversion: 2.1 time: 0.036673 May 10 20:23:17.131450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 435/862] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:17 2022] GET /compute/v2.1/servers/25f6cc79-11c0-4244-ac21-ac182db7d7cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:17.133201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:17.133830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:17.136949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.141765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.141765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.149976 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.152038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.153536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.154781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.191043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.191643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.192375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:17.282906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.292849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b4ee0419-a341-4a9f-a8d0-4f019806c454 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.208199 May 10 20:23:17.295708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 428/863] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:17 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:17.374262 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.381979 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4fcecf88-d35e-44f0-acd6-192031b24a73 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.252697 May 10 20:23:17.383154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 436/864] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:17.793168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:17.800647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:17.814161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.814996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.816027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:17.819969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:17.897465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:17.915677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-471599e9-9ed3-49a6-a7ef-0da26ab46e8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.126411 May 10 20:23:17.921228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 429/865] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:17 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:18.105673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:18.106619 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:18.115974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.115974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.116517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.116957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.273350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:18.282000 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:18.283946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:18.285406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-36292bfc-ab28-4af6-8b6f-499e897f024e tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.184257 May 10 20:23:18.286216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 437/866] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:18 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:18.314385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:18.315640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:18.322275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.322808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.323686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.324195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.356875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.357973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.358529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:18.402060 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:18.402743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:18.408374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:18.409246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.409702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.410539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.410979 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.422996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-423a630f-5eab-4e37-9118-5c7edd650000 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.114664 May 10 20:23:18.423597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 430/867] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:18 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:18.646792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:18.684110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6af4bd34-a23e-4191-9de2-939930f6fb08 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.285264 May 10 20:23:18.685347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 438/868] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:18 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:18.933938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:18.934832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:18.941915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.942548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:18.943737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:18.944068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.014693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.022071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-746c2211-df9c-4b1a-9731-89a704d0da2c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.092018 May 10 20:23:19.026242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 431/869] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:18 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:19.304112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:19.306986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:19.313793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.314556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.315413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.315801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.440490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:19.441762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:19.452353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.457185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.457185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.457185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.462224 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.477243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.480547 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.488427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-86441696-c60b-4964-b2d3-2c5dafb1d2a5 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.183095 May 10 20:23:19.488427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 439/870] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:19 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:19.493954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.494674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.495311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lazy-loading 'fault' on Instance uuid 0f9c1d58-2493-43f6-b011-90a3bac5ac0d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:23:19.563518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.571023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e85f379b-71a2-4f95-b6c6-212bb11683c4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 200 len: 1230 microversion: 2.1 time: 0.134393 May 10 20:23:19.572492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 432/871] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:19 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:19.702709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:19.703449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:19.710115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.710518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.711358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:19.712174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:19.851837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:19.859483 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a09cf769-7e1a-4cff-9a27-192a418dda18 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.161731 May 10 20:23:19.860057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 440/872] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:20.038892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:20.039438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:20.050649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.050649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.050649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.050649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.113443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:20.123295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3a2bb3e-67cf-48e9-8383-261ab3a1254f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1271 microversion: 2.1 time: 0.087720 May 10 20:23:20.124634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 433/873] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:20 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:20.501809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:20.502986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:20.509138 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.509631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.510460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.511058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.588742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:20.589363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:20.595483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.596000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.596700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.597132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.619828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] HTTP exception thrown: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Request method failure captured: May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d HTTP/1.1 May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesjRlloT3y7c_S8w-0jnG6uodWut4Bc5QmaKowhbdGgx4vtVmc0IMC-IbQZOZ2huX-rN5CHz8GFYe1N8G72JncWuMj2MPCbj-rE3F39N5x2HclVirc0UxKk_5NyVn2yTKGmcWXYndbH32w4Ku8-kPYJvO3A50vwOd9zlvE2lTwarNcg May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:23:20.630378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_93dce3ce114d427895f446e0ed0f7e4f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-312230550 May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-312230550-project May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 46916c5b15254c529bc52ecb711fdd76 May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-312230550-project May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:23:20.631707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '0f9c1d58-2493-43f6-b011-90a3bac5ac0d'} May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:20.632670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:23:20.633987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:20.635383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Returning 404 to user: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:20.635383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-404d2d64-e36f-4013-916a-1dec748e8e1a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 404 len: 111 microversion: 2.1 time: 0.040212 May 10 20:23:20.635383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 434/874] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:20 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:23:20.728798 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:20.739310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:20.741616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:20.743135 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7cd69412-e468-47bb-a15b-03670c553ff3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.246095 May 10 20:23:20.746135 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 441/875] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:20 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:20.799934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-477999104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-603570155", "security_groups": [{"name": "tempest-secgroup-smoke-823694651"}], "block_device_mapping_v2": [{"uuid": "2ea987fb-020b-46eb-852e-d4301ebd3e69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5faeb9f8-90a5-4864-8255-be306f147ea8"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:20.877365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:20.880437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:20.892216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.892799 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:20.893867 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:20.894421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:21.023929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] validate_networks() for [('5faeb9f8-90a5-4864-8255-be306f147ea8', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:23:21.064786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:21.074473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f9a6f011-90d2-4da5-9527-5362b3f2ef5e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1576 microversion: 2.1 time: 0.201661 May 10 20:23:21.075278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 442/876] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:21.145374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:21.146193 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:21.153005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:21.155317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:21.155317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:21.155317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:21.231528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:21.239393 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-664c68b2-03e5-45c2-9904-fcaea961bb14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1277 microversion: 2.1 time: 0.098241 May 10 20:23:21.240001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 443/877] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:21 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:21.764704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:21.765374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:21.771960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:21.772411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:21.773185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:21.773624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:21.903496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:21.912107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:21.913632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:21.914912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a46eb920-0e66-4a56-b2dd-31f1eef5d821 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.154887 May 10 20:23:21.915534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 444/878] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:21 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:23:22.067513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:23:22.067982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:23:22.068413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:23:22.068880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:23:22.069300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:23:22.077977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.078465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.079573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.080015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.095072 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:22.095709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:22.097323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:23:22.101385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Getting quotas for user 46916c5b15254c529bc52ecb711fdd76 and project 93dce3ce114d427895f446e0ed0f7e4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:23:22.105986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.105986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.105986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.105986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.168229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:23:22.171005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea987fb-020b-46eb-852e-d4301ebd3e69',volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:23:22.271250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:22.278624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-44ee33ea-6d2e-4e8d-a308-a2d33a4af1f1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1563 microversion: 2.1 time: 0.190171 May 10 20:23:22.279205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 445/879] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:22.283778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:22.284393 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:22.290248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.291160 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.291612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.292323 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.465232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:22.473636 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ed77eca7-704b-479e-8997-29db110627cd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.193384 May 10 20:23:22.474463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 446/880] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:22 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:22.673139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2651ef9c-140e-4770-b086-f5e3bb0b3129 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.878309 May 10 20:23:22.674876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 435/881] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:23:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:23:22.688066 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ebfe7e24-06e1-4569-b95c-e40ff5bd9972 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:22.694046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ebfe7e24-06e1-4569-b95c-e40ff5bd9972 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:22.752454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ebfe7e24-06e1-4569-b95c-e40ff5bd9972 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:22.760791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ebfe7e24-06e1-4569-b95c-e40ff5bd9972 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1093 microversion: 2.1 time: 0.078361 May 10 20:23:22.773502 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 447/882] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1093 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:22.932831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:22.933450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:22.939393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.939843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:22.940660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:22.941094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.149831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:23.158574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:23.160285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:23.161616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bd22bea5-0e38-44b1-9bdc-6b38895c2b53 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.232785 May 10 20:23:23.162495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 436/883] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:22 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:23.491148 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:23.492122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:23.500391 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:23.501095 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.501960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:23.502532 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.541647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-5180662a-1a29-4c81-8fd1-f68fd4117139 req-b1236fd8-d13f-4edf-9cf7-1e10fa595221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a14b0f0-0ea3-4957-8c38-5821bf570414", "tag": "c1b55a22-4b30-47be-a7ec-ee33cb223d31"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:23.551663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5180662a-1a29-4c81-8fd1-f68fd4117139 req-b1236fd8-d13f-4edf-9cf7-1e10fa595221 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:23.552106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5180662a-1a29-4c81-8fd1-f68fd4117139 req-b1236fd8-d13f-4edf-9cf7-1e10fa595221 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.565500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-5180662a-1a29-4c81-8fd1-f68fd4117139 req-b1236fd8-d13f-4edf-9cf7-1e10fa595221 service nova] Creating event network-changed:c1b55a22-4b30-47be-a7ec-ee33cb223d31 for instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 on hv-cinder-82880 May 10 20:23:23.573884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-5180662a-1a29-4c81-8fd1-f68fd4117139 req-b1236fd8-d13f-4edf-9cf7-1e10fa595221 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033984 May 10 20:23:23.573884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 437/884] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:23.662650 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:23.670075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4a968fb0-bca5-40b1-9639-1c036ea43521 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.182862 May 10 20:23:23.670660 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 448/885] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:23 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:23.779568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:23.780551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:23.786820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:23.790146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.790146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:23.790146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:23.865525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:23.873224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1b80761e-a7c3-41ac-89a4-2e574615058d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1143 microversion: 2.1 time: 0.098332 May 10 20:23:23.873803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 438/886] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:23.988837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c7229360-a305-4dc6-b4ba-3bf3c5829988 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Action: 'create', calling method: .version_select at 0x7f602e24ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1804586724", "metadata": {"Type": "work"}}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:24.184108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:24.184730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:24.191662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.192114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.192885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.193322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.379709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:24.387472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:24.388967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:24.391073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b0176e3f-2a11-4b3d-a079-37068d99ba10 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.210848 May 10 20:23:24.396499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 439/887] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:24 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:23:24.559758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-dac4eb59-421c-418a-94ee-69a8038b4bf4 req-cedbe38c-5ec5-497e-a001-7c015db9d725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "name": "network-vif-plugged", "status": "completed", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:24.570902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dac4eb59-421c-418a-94ee-69a8038b4bf4 req-cedbe38c-5ec5-497e-a001-7c015db9d725 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.571450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dac4eb59-421c-418a-94ee-69a8038b4bf4 req-cedbe38c-5ec5-497e-a001-7c015db9d725 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.583098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-dac4eb59-421c-418a-94ee-69a8038b4bf4 req-cedbe38c-5ec5-497e-a001-7c015db9d725 service nova] Creating event network-vif-plugged:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:23:24.587943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-dac4eb59-421c-418a-94ee-69a8038b4bf4 req-cedbe38c-5ec5-497e-a001-7c015db9d725 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 May 10 20:23:24.588747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 440/888] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:23:24.657761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c7229360-a305-4dc6-b4ba-3bf3c5829988 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.783217 May 10 20:23:24.658418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 449/889] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 20:23:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 785 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 20:23:24.670951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0e605d22-0034-4cbd-9df0-cc344a8c456f tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f6028f314c0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:24.691810 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:24.692449 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:24.704938 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.705398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.723703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.723703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.756869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0e605d22-0034-4cbd-9df0-cc344a8c456f tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 200 len: 353 microversion: 2.1 time: 0.091010 May 10 20:23:24.757712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 441/890] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:23:24 2022] GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:24.877793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:24.890994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:24.891221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6c86a6d3-27aa-4dca-a4b3-b3753e909801 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.207338 May 10 20:23:24.891731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:24.900673 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 450/891] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:24 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:24.905984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.906503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.907291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:24.907744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:24.972680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:24.980076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d51f03c6-60a4-497b-b3b7-8282de12652e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1199 microversion: 2.1 time: 0.093615 May 10 20:23:24.980649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 442/892] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:25.409879 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:25.410640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:25.416765 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:25.417216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:25.418004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:25.418481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:25.551038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:25.559349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:25.562035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:25.563520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-85bfc151-3669-48dc-9c67-edf5ca69d719 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.158087 May 10 20:23:25.564294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 451/893] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:25 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:25.769710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2614cd66-33fc-420d-8be4-fc7c3f204d28 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f6028f31e50>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:25.817325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2614cd66-33fc-420d-8be4-fc7c3f204d28 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 200 len: 354 microversion: 2.1 time: 0.051247 May 10 20:23:25.818163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 443/894] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:23:25 2022] GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:25.838476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8cf69fa7-56e5-424b-bd81-42ccb2c802a8 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f602e1d2b80>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:25.885292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8cf69fa7-56e5-424b-bd81-42ccb2c802a8 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 200 len: 354 microversion: 2.1 time: 0.050577 May 10 20:23:25.885861 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 452/895] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:23:25 2022] GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:25.902634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfd40c80-d390-45a9-b6da-60df8c5a810c tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f6029522af0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:25.909481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:25.910307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:25.916507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:25.916966 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:25.917746 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:25.918386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:26.050360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:26.059679 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-167c48f3-34e4-4b60-9d9b-1dac01edbc05 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.155539 May 10 20:23:26.060836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 453/896] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:25 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:26.066972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:26.066972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:26.072085 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:26.072574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:26.073357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:26.073822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:26.111867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bfd40c80-d390-45a9-b6da-60df8c5a810c tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 202 len: 0 microversion: 2.1 time: 0.213121 May 10 20:23:26.112350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 444/897] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:23:25 2022] DELETE /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:23:26.120391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-05cc656f-7af3-4af7-9f36-48a691d86748 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f6028e45b80>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:26.212535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-05cc656f-7af3-4af7-9f36-48a691d86748 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 200 len: 353 microversion: 2.1 time: 0.095719 May 10 20:23:26.213127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 445/898] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:23:26 2022] GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:26.254266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:26.262212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f00abf97-6821-49d8-92e4-f24af5054797 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1276 microversion: 2.1 time: 0.200157 May 10 20:23:26.262793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 454/899] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:26.582008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:26.582810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:26.589171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:26.589746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:26.590686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:26.591264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:26.788812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:26.799170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:26.800840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:26.802052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6575fad9-cc30-4b3a-8de6-e09153b6ebdc tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.224127 May 10 20:23:26.802947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 446/900] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:26 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:27.083651 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:27.085202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:27.104186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.105014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.107747 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.114884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.225917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-caf1a680-a6a7-451c-b23c-ab8adcb69442 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Calling method '.version_select at 0x7f6028f31040>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:27.256866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-caf1a680-a6a7-451c-b23c-ab8adcb69442 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] HTTP exception thrown: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-caf1a680-a6a7-451c-b23c-ab8adcb69442 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Request method failure captured: May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 HTTP/1.1 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesm7aQdyRJ20t8no3yid-s9gnK9_RkNIoMFfmvXhDj0FBt8vUfdlz34YcYAN3pMilSVhPqfxq6PSt9z6i2MJDVLbmp0ZfDf40oO0lztzh_O3OCcZI01XHM_qLxUc19U_cafrHlEhaoHbBsMQjp4IDMNLlISUAv2oDqBllk7BLho_eQ8 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: e9bc233a626643f0a6954adc2a215f6c May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesGetTestJSON-37885032 May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:23:27.259391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e9bc233a626643f0a6954adc2a215f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e9bc233a626643f0a6954adc2a215f6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e9bc233a626643f0a6954adc2a215f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e9bc233a626643f0a6954adc2a215f6c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesGetTestJSON-37885032 May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: e9bc233a626643f0a6954adc2a215f6c May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesGetTestJSON-37885032 May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesGetTestJSON-37885032-project May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 93b74480c62f4e179089f48b91bd7f28 May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesGetTestJSON-37885032-project May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '4f0f2939-dbd0-4bbe-bb91-1be02514d158'} May 10 20:23:27.260993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. (HTTP 404) (Request-ID: req-4e0ca695-2b92-4a20-81c1-b74db0d40246) May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:27.261998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:23:27.264059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:23:27.265276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-caf1a680-a6a7-451c-b23c-ab8adcb69442 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] Returning 404 to user: Volume 4f0f2939-dbd0-4bbe-bb91-1be02514d158 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-caf1a680-a6a7-451c-b23c-ab8adcb69442 tempest-VolumesGetTestJSON-37885032 tempest-VolumesGetTestJSON-37885032-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158" status: 404 len: 109 microversion: 2.1 time: 0.040748 May 10 20:23:27.266538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 447/901] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:23:27 2022] GET /compute/v2.1/os-volumes/4f0f2939-dbd0-4bbe-bb91-1be02514d158 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:23:27.277458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:27.278820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:27.280093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:27.287881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0e574c5b-09b4-47bf-8a82-5afdc531c3ee tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.214709 May 10 20:23:27.289952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 455/902] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:27 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:27.296676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.297120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.297908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.298365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.342027 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-3e38bf35-1995-430b-8228-c77354857424 req-288d6bce-b65c-4b86-b03c-71a7994ed46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43b1f37-3eff-4ece-bf7e-8dc94657366f", "tag": "87aa9ad9-fb81-4369-8056-73c918735898"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:27.356244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-3e38bf35-1995-430b-8228-c77354857424 req-288d6bce-b65c-4b86-b03c-71a7994ed46b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.356766 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-3e38bf35-1995-430b-8228-c77354857424 req-288d6bce-b65c-4b86-b03c-71a7994ed46b service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.371863 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-3e38bf35-1995-430b-8228-c77354857424 req-288d6bce-b65c-4b86-b03c-71a7994ed46b service nova] Creating event network-changed:87aa9ad9-fb81-4369-8056-73c918735898 for instance f43b1f37-3eff-4ece-bf7e-8dc94657366f on hv-cinder-82880 May 10 20:23:27.378301 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-3e38bf35-1995-430b-8228-c77354857424 req-288d6bce-b65c-4b86-b03c-71a7994ed46b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041499 May 10 20:23:27.391172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 456/903] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:23:27.579609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:27.587275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8dd9cbf-6fb7-42b0-817e-eb40fc93da7b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1276 microversion: 2.1 time: 0.312186 May 10 20:23:27.587852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 448/904] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:27.825415 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:27.826992 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:27.833827 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.834457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:27.835501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:27.836017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.014283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:28.036659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:28.036659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:28.036659 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-03cd025f-c745-4500-811e-530f799794d3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1731 microversion: 2.20 time: 0.204771 May 10 20:23:28.037802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 457/905] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:27 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:28.305653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:28.306248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:28.312864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:28.313317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.314118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:28.314566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.453245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:28.461362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d70a6472-252c-4105-8ec1-f1994fa5c63c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.159650 May 10 20:23:28.462268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 449/906] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:28 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:28.603901 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:28.608144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:28.613279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:28.614001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.614916 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:28.615646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.683467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-1f089c64-f424-432f-8871-e82869105383 req-728887e2-0cfe-4097-a556-85de3875e238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a14b0f0-0ea3-4957-8c38-5821bf570414", "name": "network-vif-plugged", "status": "completed", "tag": "c1b55a22-4b30-47be-a7ec-ee33cb223d31"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:28.692602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1f089c64-f424-432f-8871-e82869105383 req-728887e2-0cfe-4097-a556-85de3875e238 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:28.693055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1f089c64-f424-432f-8871-e82869105383 req-728887e2-0cfe-4097-a556-85de3875e238 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:28.705327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-1f089c64-f424-432f-8871-e82869105383 req-728887e2-0cfe-4097-a556-85de3875e238 service nova] Creating event network-vif-plugged:c1b55a22-4b30-47be-a7ec-ee33cb223d31 for instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 on hv-cinder-82880 May 10 20:23:28.710820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-1f089c64-f424-432f-8871-e82869105383 req-728887e2-0cfe-4097-a556-85de3875e238 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 May 10 20:23:28.711436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 450/907] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:23:28.785167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:28.793147 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2556d314-dd3a-4e0f-9eff-da4ec1de0020 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.193547 May 10 20:23:28.793854 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 458/908] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:29.045923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:29.046761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:29.053605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.054634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:29.055503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.056014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:29.188572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:29.196636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:29.198151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:29.208204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a979de17-ee53-43c7-bef3-0e4c06178bd2 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1718 microversion: 2.20 time: 0.158590 May 10 20:23:29.208204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 451/909] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:23:29 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:23:29.478170 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:29.478784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:29.485283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.485738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:29.486543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.486981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:29.613145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:29.620539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e2128bbe-144a-41fe-955f-a75df3569e60 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1319 microversion: 2.1 time: 0.146191 May 10 20:23:29.621189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 459/910] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:29 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:29.810025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:29.811381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:29.817582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.818028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:29.818823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:29.819258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:30.011341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:30.019508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ade0d629-57dc-452c-87f9-198eb288946c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.213356 May 10 20:23:30.020351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 452/911] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:30.637632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:30.638285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:30.644221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:30.644675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:30.645453 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:30.645893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:30.778248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:30.785776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f82d6c8-cabb-445a-b743-648349a91e8b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1509 microversion: 2.1 time: 0.151806 May 10 20:23:30.786440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 460/912] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:30 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:31.036728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:31.038713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:31.046046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:31.046525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:31.047306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:31.047748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:31.181852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:31.189935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a1dc8a9-1745-4a0f-b5d7-544ced4c84e5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.157749 May 10 20:23:31.190549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 453/913] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:32.207472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:32.208243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:32.214503 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:32.214968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:32.215748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:32.216191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:32.358423 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:32.365956 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b225b15e-182e-455e-9d27-9616bb395f10 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.162691 May 10 20:23:32.366561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 461/914] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:33.382911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:33.383565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:33.390652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:33.391111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:33.391951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:33.392394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:33.525462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:33.534041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fa688dea-0ba9-488c-80f8-8fea8133514e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.154995 May 10 20:23:33.534652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 454/915] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:23:34.551265 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:34.551950 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:34.558655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:34.559114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:34.559905 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:34.560347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:34.696176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:34.706617 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5e7655f3-8b2d-4ecc-9e41-41826fa62c58 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.156586 May 10 20:23:34.707309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 462/916] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:35.724342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:35.724958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:35.731315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:35.731875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:35.732540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:35.732983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:35.864364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:35.871606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-503bca84-7a82-457e-add1-49c5f05663b4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.151127 May 10 20:23:35.872180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 455/917] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:36.888548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:36.889189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:36.901379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:36.901843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:36.902934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:36.903386 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:37.045622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:37.053781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bf0ea2fc-dceb-4e6a-a60a-7fa85bd0e23c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.169204 May 10 20:23:37.058074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 463/918] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:38.072741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:38.073424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:38.080788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:38.081242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:38.082026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:38.082586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:38.218806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:38.226006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1040144f-6da2-49cc-9ab4-901c4f6aeb78 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.157151 May 10 20:23:38.226608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 456/919] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:39.185612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a4682d4c-8b1b-438f-8599-2c151f85bbf1 req-a4a27fcd-eeb7-4600-bbee-312917655b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b1f37-3eff-4ece-bf7e-8dc94657366f", "name": "network-vif-plugged", "status": "completed", "tag": "87aa9ad9-fb81-4369-8056-73c918735898"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:39.201632 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a4682d4c-8b1b-438f-8599-2c151f85bbf1 req-a4a27fcd-eeb7-4600-bbee-312917655b85 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:39.202120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a4682d4c-8b1b-438f-8599-2c151f85bbf1 req-a4a27fcd-eeb7-4600-bbee-312917655b85 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:39.213240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a4682d4c-8b1b-438f-8599-2c151f85bbf1 req-a4a27fcd-eeb7-4600-bbee-312917655b85 service nova] Creating event network-vif-plugged:87aa9ad9-fb81-4369-8056-73c918735898 for instance f43b1f37-3eff-4ece-bf7e-8dc94657366f on hv-cinder-82880 May 10 20:23:39.218915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a4682d4c-8b1b-438f-8599-2c151f85bbf1 req-a4a27fcd-eeb7-4600-bbee-312917655b85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036544 May 10 20:23:39.219761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 464/920] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:39.244224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:39.244860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:39.254974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:39.255426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:39.256420 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:39.256865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:39.421267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:39.429475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e99294c4-6575-496a-b122-aa1a1ebd7bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.190008 May 10 20:23:39.430162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 457/921] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:40.447114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:40.447808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:40.455073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:40.455520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:40.456303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:40.456739 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:40.590914 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:40.598901 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-84e4ee89-e21c-4588-b569-2a2d16507605 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1264 microversion: 2.1 time: 0.156044 May 10 20:23:40.600107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 465/922] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:41.616937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:41.617573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:41.623965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:41.624415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:41.625700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:41.626163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:41.769774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:41.777412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bc37dc02-c26d-4d39-9839-d94d1871e28b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1451 microversion: 2.1 time: 0.164620 May 10 20:23:41.777983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 458/923] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:41.793293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:23:41.793995 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:41.800968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:41.801422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:41.802363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:41.802809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:41.937917 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:23:41.945417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b257fbf8-0ac0-44b2-9a41-34b4ba0933aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1451 microversion: 2.1 time: 0.155994 May 10 20:23:41.945986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 466/924] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:23:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:23:44.437760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-9effdaa3-a6b8-47a1-9c8e-e0712debd137 req-c7d8e920-2eb1-4a0b-ac4c-ef03edabb493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43b1f37-3eff-4ece-bf7e-8dc94657366f", "tag": "87aa9ad9-fb81-4369-8056-73c918735898"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:44.448042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9effdaa3-a6b8-47a1-9c8e-e0712debd137 req-c7d8e920-2eb1-4a0b-ac4c-ef03edabb493 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:44.448722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9effdaa3-a6b8-47a1-9c8e-e0712debd137 req-c7d8e920-2eb1-4a0b-ac4c-ef03edabb493 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:44.465366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-9effdaa3-a6b8-47a1-9c8e-e0712debd137 req-c7d8e920-2eb1-4a0b-ac4c-ef03edabb493 service nova] Creating event network-changed:87aa9ad9-fb81-4369-8056-73c918735898 for instance f43b1f37-3eff-4ece-bf7e-8dc94657366f on hv-cinder-82880 May 10 20:23:44.471128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-9effdaa3-a6b8-47a1-9c8e-e0712debd137 req-c7d8e920-2eb1-4a0b-ac4c-ef03edabb493 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224829 May 10 20:23:44.472100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 459/925] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:23:48.294640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ae29f6-0c5b-4df9-88b2-c78530b3e5ba", "device": "/dev/sdb"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:23:48.296219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:23:48.302786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:48.303244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:48.304030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:23:48.304476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:23:48.992217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9f15c5b2-59f5-48a6-9725-2529f6937f74 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "POST /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700195 May 10 20:23:48.992885 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 467/926] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:23:48 2022] POST /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:16.513182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:16.513767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:16.519866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:16.520314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:16.521126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:16.521563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:16.601034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lazy-loading 'services' on Instance uuid 6a14b0f0-0ea3-4957-8c38-5821bf570414 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:24:16.845712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-39d12608-e617-49cf-b4d2-b86f8bc4cd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414/os-volume_attachments/b1ae29f6-0c5b-4df9-88b2-c78530b3e5ba" status: 202 len: 0 microversion: 2.1 time: 0.337693 May 10 20:24:16.846347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 460/927] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:24:16 2022] DELETE /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414/os-volume_attachments/b1ae29f6-0c5b-4df9-88b2-c78530b3e5ba => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:24:17.414958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:17.416056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:17.422458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.422963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.423760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.424202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.457469 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a41e4428-9017-4f98-ae82-22d07ae12e42 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047914 May 10 20:24:17.458048 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 468/928] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 20:24:17 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:17.530627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:17.531233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:17.537440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.537893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.538712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.539650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.567013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:24:17.869923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-675f497d-172c-4a42-84a9-f6a0578dbccd tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 204 len: 0 microversion: 2.20 time: 0.347486 May 10 20:24:17.870557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 461/929] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 20:24:17 2022] DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:24:17.878776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:17.879472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:17.885373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.885824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.886628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.887072 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.956802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:17.957396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:17.963738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.964188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.964965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:17.965408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:17.990878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:24:18.025002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:18.032860 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:18.034380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:18.035544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-13fea780-e138-47bc-b5c9-779cafba9c85 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.160848 May 10 20:24:18.036170 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 469/930] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:17 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:24:18.266075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af507fa3-1a81-4b84-b53f-05fd8e10d4b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 204 len: 0 microversion: 2.1 time: 0.313502 May 10 20:24:18.266692 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 462/931] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:24:17 2022] DELETE /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:24:18.275433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:18.276049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:18.282036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:18.282517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:18.283281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:18.283717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:18.407952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:18.415448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-38689197-a395-46d7-9418-2d0290eccf9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1515 microversion: 2.1 time: 0.144442 May 10 20:24:18.416047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 470/932] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:18 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:19.055848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:19.057517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:19.065790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:19.066285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:19.067082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:19.067655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:19.198189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:19.206453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:19.208605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:19.209826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-406d1556-9f5d-4800-9e65-1d217f09c44b tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.159070 May 10 20:24:19.210429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 463/933] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:19 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:24:19.432100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:19.432717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:19.439137 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:19.439591 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:19.440367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:19.440808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:19.571174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:19.578645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-680ead74-8da6-4a45-afb4-ce1e526d7a9a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1515 microversion: 2.1 time: 0.150434 May 10 20:24:19.579219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 471/934] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:19 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:20.229006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:20.229626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:20.236023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:20.240356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:20.240356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:20.240356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:20.365175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:20.372955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:20.374493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:20.375737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c217c20-164b-4099-b87b-8a847595f196 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1724 microversion: 2.20 time: 0.151076 May 10 20:24:20.376341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 464/935] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:20 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:24:20.596657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:20.597275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:20.603596 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:20.604051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:20.604824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:20.605271 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:20.749836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:20.757948 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ace32793-0861-4408-a52d-956815f925b0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1515 microversion: 2.1 time: 0.165137 May 10 20:24:20.759467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 472/936] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:20 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:21.334841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-321fe6c3-1702-4239-a5e0-0ee66aaaa45c req-cf2bb5f1-925c-42e5-9b6d-c2d8918b6b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a14b0f0-0ea3-4957-8c38-5821bf570414", "name": "network-vif-deleted", "tag": "c1b55a22-4b30-47be-a7ec-ee33cb223d31"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:21.343555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-321fe6c3-1702-4239-a5e0-0ee66aaaa45c req-cf2bb5f1-925c-42e5-9b6d-c2d8918b6b33 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.344007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-321fe6c3-1702-4239-a5e0-0ee66aaaa45c req-cf2bb5f1-925c-42e5-9b6d-c2d8918b6b33 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.356088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-321fe6c3-1702-4239-a5e0-0ee66aaaa45c req-cf2bb5f1-925c-42e5-9b6d-c2d8918b6b33 service nova] Creating event network-vif-deleted:c1b55a22-4b30-47be-a7ec-ee33cb223d31 for instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 on hv-cinder-82880 May 10 20:24:21.360988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-321fe6c3-1702-4239-a5e0-0ee66aaaa45c req-cf2bb5f1-925c-42e5-9b6d-c2d8918b6b33 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029726 May 10 20:24:21.364759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 465/937] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:21.394112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:21.394654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:21.402565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.403223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.405179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.405179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.467128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:21.475166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:21.477261 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:21.478525 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-45ecb8eb-2a98-4252-b1b0-b4edfaa8047a tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1657 microversion: 2.20 time: 0.088549 May 10 20:24:21.479208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 473/938] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:21 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:24:21.648269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-242716ef-35e1-48ef-ad64-54232303539a req-04b67ea0-46b6-44fa-897c-c7fd7b9c3564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b925038-2c3c-4a07-a98a-56c1df0786e5", "name": "network-vif-deleted", "tag": "063af925-b83e-40dd-8134-6b074fb2357d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:21.657261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-242716ef-35e1-48ef-ad64-54232303539a req-04b67ea0-46b6-44fa-897c-c7fd7b9c3564 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.657736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-242716ef-35e1-48ef-ad64-54232303539a req-04b67ea0-46b6-44fa-897c-c7fd7b9c3564 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.669263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-242716ef-35e1-48ef-ad64-54232303539a req-04b67ea0-46b6-44fa-897c-c7fd7b9c3564 service nova] Creating event network-vif-deleted:063af925-b83e-40dd-8134-6b074fb2357d for instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 on hv-cinder-82880 May 10 20:24:21.674501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-242716ef-35e1-48ef-ad64-54232303539a req-04b67ea0-46b6-44fa-897c-c7fd7b9c3564 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030379 May 10 20:24:21.675096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 466/939] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:21.777490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:21.778228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:21.786420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.786965 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.787831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.788343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.824866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:21.825435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:21.825993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lazy-loading 'fault' on Instance uuid 6a14b0f0-0ea3-4957-8c38-5821bf570414 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:24:21.868087 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:21.877112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4c21aa21-fa4b-4390-8d85-7aa9508d599f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 200 len: 1309 microversion: 2.1 time: 0.104339 May 10 20:24:21.877782 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 474/940] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:21 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:22.498896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:22.499615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:22.506226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:22.506675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:22.507476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:22.507972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:22.560669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:22.560826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:22.561261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lazy-loading 'fault' on Instance uuid 8b925038-2c3c-4a07-a98a-56c1df0786e5 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:24:22.604237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:22.613003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:22.613919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8feebf7f09cb4f7d81759f8f1336dba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5cecfb8eb5e4b8ea121c2ef8a9c28a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:22.615118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-23b97440-127a-4148-b33f-86ebe1085979 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 200 len: 1371 microversion: 2.20 time: 0.121332 May 10 20:24:22.616227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 467/941] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:22 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:24:22.894805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:22.895423 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 6a14b0f0-0ea3-4957-8c38-5821bf570414] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:22.902303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:22.902768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:22.903561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:22.904507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:22.918110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] HTTP exception thrown: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Request method failure captured: May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 HTTP/1.1 May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesmoTJ999AJ8JxW0BSUNw2ylVdS1suVIS5DBDpaJHtw6vMbZQPATRJoJxWHIOpxD6Xqwe_Ehlxo9fJevW9RJqa5mzEshbrMPCF7lmCelqTobPi36Htf8LsdFwPpLicSBeJwcQPTyI1dTxO4NXWX2WsNoUimEkEjAgZ7ScsZc-VsaS_c May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: 498ce5260ee44f5d9b1ebc74fecedfbf May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2061075845 May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:24:22.919800 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/498ce5260ee44f5d9b1ebc74fecedfbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/498ce5260ee44f5d9b1ebc74fecedfbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/498ce5260ee44f5d9b1ebc74fecedfbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_498ce5260ee44f5d9b1ebc74fecedfbf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesSnapshotTestJSON-2061075845 May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 498ce5260ee44f5d9b1ebc74fecedfbf May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2061075845 May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesSnapshotTestJSON-2061075845-project May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 77e46909519247119a6bc011b6bcfc7c May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesSnapshotTestJSON-2061075845-project May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. May 10 20:24:22.921698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '6a14b0f0-0ea3-4957-8c38-5821bf570414'} May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:22.922631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. May 10 20:24:22.923978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:22.925141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Returning 404 to user: Instance 6a14b0f0-0ea3-4957-8c38-5821bf570414 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:22.925141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b319fd8d-93cd-41c7-b031-a887bf15e7aa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414" status: 404 len: 111 microversion: 2.1 time: 0.030293 May 10 20:24:22.925141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 475/942] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:22 2022] GET /compute/v2.1/servers/6a14b0f0-0ea3-4957-8c38-5821bf570414 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:24:23.635096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:23.636400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:23.642607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:23.643055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:23.643830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:23.644267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:23.657419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 HTTP/1.1 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:24:23.659076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:23.660784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '8b925038-2c3c-4a07-a98a-56c1df0786e5'} May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:23.661714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:23.663253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:23.664674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:23.664674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b2e61faf-8241-4a62-a0ea-cb27a9ff0bd3 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 404 len: 111 microversion: 2.20 time: 0.030257 May 10 20:24:23.664674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 468/943] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:23 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:24:23.670016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fe459684-a65b-4c08-a500-87c8c0d85055 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '.version_select at 0x7f602e166160>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:23.779470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fe459684-a65b-4c08-a500-87c8c0d85055 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124578762" status: 204 len: 0 microversion: 2.20 time: 0.113182 May 10 20:24:23.779985 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 476/944] 10.222.0.65 () {60 vars in 1258 bytes} [Tue May 10 20:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124578762 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:24:26.790151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:26.790678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:26.796897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:26.797595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:26.798183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:26.798623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:26.812600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 HTTP/1.1 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:24:26.814221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.816016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '8b925038-2c3c-4a07-a98a-56c1df0786e5'} May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:26.817040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.818590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:26.820187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:26.820187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4423a348-ba7f-4ff0-8adc-716ec28fac99 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 404 len: 111 microversion: 2.20 time: 0.029712 May 10 20:24:26.820187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 469/945] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 20:24:26 2022] DELETE /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 20:24:26.825114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:26.826377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 8b925038-2c3c-4a07-a98a-56c1df0786e5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:26.832646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:26.833146 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:26.833904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:26.834379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:26.847612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 HTTP/1.1 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:24:26.849130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.855446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '8b925038-2c3c-4a07-a98a-56c1df0786e5'} May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:26.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. May 10 20:24:26.857988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:26.859392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 8b925038-2c3c-4a07-a98a-56c1df0786e5 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:26.859392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3172eb8a-b646-47e6-8bb4-124c13772215 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5" status: 404 len: 111 microversion: 2.20 time: 0.030406 May 10 20:24:26.859392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 477/946] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:26 2022] GET /compute/v2.1/servers/8b925038-2c3c-4a07-a98a-56c1df0786e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:24:28.162179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:28.162690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:28.168989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:28.169442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:28.170248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:28.170687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:28.184299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d HTTP/1.1 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:24:28.185828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.190929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '5ab6f0a6-aa14-407a-b43d-7b7d2855499d'} May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:28.191830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.193335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:24:28.194864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:28.194864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a232dd2-884d-43a0-b514-ae0ed610554d tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 404 len: 111 microversion: 2.20 time: 0.029127 May 10 20:24:28.194864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 470/947] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 20:24:28 2022] DELETE /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:24:28.196915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:28.197525 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] [instance: 5ab6f0a6-aa14-407a-b43d-7b7d2855499d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:28.203893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:28.204344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:28.205370 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:28.205805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:28.220990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] HTTP exception thrown: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Request method failure captured: May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d HTTP/1.1 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept: application/json May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Connection: close May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Length: 0 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Content-Type: application/json May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Host: 10.222.0.65 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiesg3qsTBA5gCeEkWPKJzDBCxDe99HB_2sfw5wE49H-7GxmYO6FOPVmoMNS3JpUHrb9Py6S-DQzCb724jVs2LoFLANqP0tGqqa98RlLwT4z94i2CrCtF1uUsi_-MAPqgIsKqIc4p6-1k3YZpS5FOeWCpa3bpOF91qO43vYII4-5PPbG8 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Id: None May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Domain-Name: None May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Role: member,reader May 10 20:24:28.222869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Roles: member,reader May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5cecfb8eb5e4b8ea121c2ef8a9c28a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5cecfb8eb5e4b8ea121c2ef8a9c28a2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Id: d5cecfb8eb5e4b8ea121c2ef8a9c28a2 May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769646234 May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Id: 8feebf7f09cb4f7d81759f8f1336dba5 May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769646234-project May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: method: > May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: exception: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.224555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: action_args: {'id': '5ab6f0a6-aa14-407a-b43d-7b7d2855499d'} May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:24:28.225466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. May 10 20:24:28.227076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi May 10 20:24:28.228388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] Returning 404 to user: Instance 5ab6f0a6-aa14-407a-b43d-7b7d2855499d could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:24:28.228388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-97aa9884-c97f-418c-9f3b-ef04ac591705 tempest-AttachVolumeShelveTestJSON-769646234 tempest-AttachVolumeShelveTestJSON-769646234-project] 10.222.0.65 "GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d" status: 404 len: 111 microversion: 2.20 time: 0.031667 May 10 20:24:28.228388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 478/948] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 20:24:28 2022] GET /compute/v2.1/servers/5ab6f0a6-aa14-407a-b43d-7b7d2855499d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 20:24:31.297637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-522587740", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "networks": [{"uuid": "8750fcec-68a3-4030-8b36-de70cc9667b1"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:31.348584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] validate_networks() for [('8750fcec-68a3-4030-8b36-de70cc9667b1', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:24:31.949341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:24:31.949746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:24:31.950261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:24:31.950672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:24:31.951079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:24:31.959968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:31.960406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:31.961253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:31.961681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:31.977714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Getting quotas for project 498ce5260ee44f5d9b1ebc74fecedfbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:24:31.987216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Getting quotas for user 77e46909519247119a6bc011b6bcfc7c and project 498ce5260ee44f5d9b1ebc74fecedfbf. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:24:31.993965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:24:31.996341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:24:32.214604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-81065302-66ac-4fba-8067-1e21923cf84f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920883 May 10 20:24:32.215244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 471/949] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:24:32.225239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bcba0f97-9533-4e9c-b196-3ae200061b8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:32.225845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bcba0f97-9533-4e9c-b196-3ae200061b8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:32.280112 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bcba0f97-9533-4e9c-b196-3ae200061b8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:32.288874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bcba0f97-9533-4e9c-b196-3ae200061b8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1218 microversion: 2.1 time: 0.067485 May 10 20:24:32.290768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 479/950] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:33.307349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:33.308538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:33.314729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:33.315176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:33.316206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:33.316721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:33.381635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:33.391695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e0fb4458-a415-48ec-a63b-7be8093487da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1222 microversion: 2.1 time: 0.088390 May 10 20:24:33.392509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 472/951] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:34.410767 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:34.411870 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:34.421106 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:34.422020 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:34.422939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:34.423480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:34.515653 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:34.524663 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cdb7f4ea-d5ce-4e5e-a77a-fff70661b234 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1278 microversion: 2.1 time: 0.119804 May 10 20:24:34.529426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 480/952] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:34 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:35.541592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:35.542311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:35.555509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:35.555509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:35.555509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:35.555509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:35.690982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:35.698336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c7f5538-119b-4b3d-a433-5e66ad4d2513 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.161147 May 10 20:24:35.698915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 473/953] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:36.080698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-db52b661-ab02-419c-822c-ca6980a73d86 req-6825af7b-4195-4752-ad3c-72d10ee19f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb90d6b-7083-4118-94fa-736fbc886744", "tag": "1b69dc72-245c-49f9-855f-4cf1a1b1b094"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:36.090620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-db52b661-ab02-419c-822c-ca6980a73d86 req-6825af7b-4195-4752-ad3c-72d10ee19f10 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:36.091212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-db52b661-ab02-419c-822c-ca6980a73d86 req-6825af7b-4195-4752-ad3c-72d10ee19f10 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:36.114198 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-db52b661-ab02-419c-822c-ca6980a73d86 req-6825af7b-4195-4752-ad3c-72d10ee19f10 service nova] Creating event network-changed:1b69dc72-245c-49f9-855f-4cf1a1b1b094 for instance 9bb90d6b-7083-4118-94fa-736fbc886744 on hv-cinder-82880 May 10 20:24:36.120019 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-db52b661-ab02-419c-822c-ca6980a73d86 req-6825af7b-4195-4752-ad3c-72d10ee19f10 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045301 May 10 20:24:36.123788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 481/954] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:36.716032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:36.716657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:36.727245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:36.727696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:36.728479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:36.728914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:36.927743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1607211899", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:36.980097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:36.990560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e5a00deb-022c-4eb1-9830-57d22f009cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.279063 May 10 20:24:36.991403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 474/955] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:36.991566 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] validate_networks() for None {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:24:37.369376 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:24:37.370014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:24:37.370506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:24:37.370911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:24:37.371321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:24:37.380472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:37.381076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:37.381718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:37.382373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:37.399978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Getting quotas for project b5515c98d19e4d53b195f1d190997208. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:24:37.404003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Getting quotas for user e5e4e9e74776483dbb264db2dd26bd17 and project b5515c98d19e4d53b195f1d190997208. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:24:37.422960 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:24:37.423349 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:24:37.541295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-45896de7-b2ec-4b0e-9889-e6d8265685d0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616554 May 10 20:24:37.542257 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 482/956] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:24:37.552552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-245035d1-cc50-41c3-bd47-32a37f625251 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:37.553629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-245035d1-cc50-41c3-bd47-32a37f625251 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:37.615186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-245035d1-cc50-41c3-bd47-32a37f625251 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:37.625274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-245035d1-cc50-41c3-bd47-32a37f625251 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1215 microversion: 2.1 time: 0.076044 May 10 20:24:37.625881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 475/957] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:37 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:38.008967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:38.009684 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:38.016029 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:38.016531 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:38.019746 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:38.019746 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:38.202875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:38.216839 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cef3d34c-04c5-437c-b6cc-142b07b0c162 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.212229 May 10 20:24:38.217351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 483/958] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:38.643467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c47161bb-1b83-40a9-b005-2ef59fe78d60 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:38.643910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c47161bb-1b83-40a9-b005-2ef59fe78d60 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:38.743359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c47161bb-1b83-40a9-b005-2ef59fe78d60 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:38.755468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c47161bb-1b83-40a9-b005-2ef59fe78d60 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1215 microversion: 2.1 time: 0.113733 May 10 20:24:38.756232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 476/959] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:38 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:39.239359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:39.241485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:39.252398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:39.253211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:39.254465 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:39.255754 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:39.414240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:39.431200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-710a7b16-6b32-40df-9e8c-b61650688236 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.199809 May 10 20:24:39.432359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 484/960] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:39.773199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:39.774499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:39.783728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:39.784682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:39.786771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:39.788323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:40.163560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:40.172341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-38e533c1-bd39-4d85-8892-258e27ca99b8 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1211 microversion: 2.1 time: 0.403398 May 10 20:24:40.172938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 477/961] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:39 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1211 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:40.449286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:40.449991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:40.457940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:40.462702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:40.463838 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:40.466231 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:40.670889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:40.686450 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ec762498-2375-4d63-9759-e26f1a44e756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.241756 May 10 20:24:40.687494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 485/962] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:40.833900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f6059bf4-d551-43a9-8426-ef4c4e722a61 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: .version_select at 0x7f602905bca0>, body: {"keypair": {"name": "tempest-keypair-946057570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjr0k9o7IY2whLN8HSkYuTvHFBJlxcWo+6u/Q5s9psRFKtD3qZWCD+l279qOsvljDoc+oFJxfSwowAfwEbifKSV0EdTHPLziqb3MPTj5IG4lV2VshXjfns1ZAkbirbNag=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:40.858005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-f6059bf4-d551-43a9-8426-ef4c4e722a61 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:24:40.863384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-f6059bf4-d551-43a9-8426-ef4c4e722a61 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:24:40.996811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f6059bf4-d551-43a9-8426-ef4c4e722a61 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.324521 May 10 20:24:40.999943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 478/963] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:24:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:41.189705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:41.190672 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:41.200253 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:41.200907 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:41.206460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:41.206460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:41.270104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:41.279444 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4270feda-9f85-45d4-a636-b58ba6ef9732 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1273 microversion: 2.1 time: 0.093972 May 10 20:24:41.280027 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 486/964] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:41 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:41.499505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-7bb990f6-c301-46b6-b134-763fb5ff2aa8 req-cc664004-11fb-4ae9-95cd-a42b23f1b600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb90d6b-7083-4118-94fa-736fbc886744", "name": "network-vif-plugged", "status": "completed", "tag": "1b69dc72-245c-49f9-855f-4cf1a1b1b094"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:41.515306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7bb990f6-c301-46b6-b134-763fb5ff2aa8 req-cc664004-11fb-4ae9-95cd-a42b23f1b600 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:41.515306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7bb990f6-c301-46b6-b134-763fb5ff2aa8 req-cc664004-11fb-4ae9-95cd-a42b23f1b600 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:41.525368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-7bb990f6-c301-46b6-b134-763fb5ff2aa8 req-cc664004-11fb-4ae9-95cd-a42b23f1b600 service nova] Creating event network-vif-plugged:1b69dc72-245c-49f9-855f-4cf1a1b1b094 for instance 9bb90d6b-7083-4118-94fa-736fbc886744 on hv-cinder-82880 May 10 20:24:41.531202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-7bb990f6-c301-46b6-b134-763fb5ff2aa8 req-cc664004-11fb-4ae9-95cd-a42b23f1b600 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039472 May 10 20:24:41.531953 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 479/965] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:41.703617 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:41.705115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:41.715906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:41.715906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:41.715906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:41.715906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:41.855456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:41.862874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-075fe5fa-330c-4ec8-8a01-21cb1176b7dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.163180 May 10 20:24:41.863436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 487/966] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:42.308262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:42.309134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:42.316817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:42.318312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:42.319302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:42.320819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:42.599662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:42.607586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9ed447df-5ad1-4b28-966f-f84bbf6eaeb6 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.304852 May 10 20:24:42.608330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 480/967] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:42 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:42.880654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:42.881857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:42.888191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:42.888635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:42.889415 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:42.889847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:43.051530 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:43.064123 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3c96a14e-f563-458a-87a4-dfa0aeeae323 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1318 microversion: 2.1 time: 0.187948 May 10 20:24:43.090439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 488/968] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:43.360281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-1c344b43-e198-4dfa-ab6d-002ad82b4ff1 req-c7cf5ee7-2c6b-4188-9fe2-e66a3854a482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11293c6a-e525-42a4-8bd3-a3c8bab24743", "tag": "474ff5fc-e7fe-4c60-a8a9-00898d145425"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:43.387696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1c344b43-e198-4dfa-ab6d-002ad82b4ff1 req-c7cf5ee7-2c6b-4188-9fe2-e66a3854a482 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:43.388397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-1c344b43-e198-4dfa-ab6d-002ad82b4ff1 req-c7cf5ee7-2c6b-4188-9fe2-e66a3854a482 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:43.408830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-1c344b43-e198-4dfa-ab6d-002ad82b4ff1 req-c7cf5ee7-2c6b-4188-9fe2-e66a3854a482 service nova] Creating event network-changed:474ff5fc-e7fe-4c60-a8a9-00898d145425 for instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 on hv-cinder-82880 May 10 20:24:43.423915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-1c344b43-e198-4dfa-ab6d-002ad82b4ff1 req-c7cf5ee7-2c6b-4188-9fe2-e66a3854a482 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061113 May 10 20:24:43.438309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 481/969] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:43.626467 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:43.627805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:43.647729 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:43.649161 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:43.650259 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:43.650945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:43.818621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:43.829035 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d85141ea-6fa1-43d8-8a3c-fb7d8346c119 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.207211 May 10 20:24:43.830520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 489/970] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:43 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:44.097622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:44.098806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:44.111114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.111707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.112598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.113116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.206281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-585730774", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97616d50-d128-4d48-95c9-0ecc4a239629"}], "security_groups": [{"name": "tempest-securitygroup--1190547675"}], "key_name": "tempest-keypair-946057570", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:44.322726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] validate_networks() for [('97616d50-d128-4d48-95c9-0ecc4a239629', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:24:44.414924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:44.423439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f94e5a09-5306-4461-bcc2-975842e3cb67 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1507 microversion: 2.1 time: 0.334557 May 10 20:24:44.424794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 482/971] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:44.446146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb47fc65-6345-4bbc-a1ef-e35f695fa451", "device": "/dev/sdb"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:44.448459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:44.455353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.456075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.457073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.457711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.739008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:24:44.739440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:24:44.739922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:24:44.741027 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:24:44.741813 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:24:44.751010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.751468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.752334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.752719 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.769958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:24:44.774560 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:24:44.786039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:24:44.788325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:24:44.937720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1edac896-cd7a-48cf-91b9-38a2b648a19e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736004 May 10 20:24:44.938406 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 490/972] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:24:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:24:44.943459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:44.944278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:44.950874 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.951413 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:44.952208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:44.952638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:45.104662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:45.115379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a4d889be-fc5b-41b2-9991-63a8517eb917 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.175748 May 10 20:24:45.115947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 491/973] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:44 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:45.120375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a9446c8-545e-4a8b-af4c-f9d636155fc1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:45.120980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a9446c8-545e-4a8b-af4c-f9d636155fc1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:45.173783 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a9446c8-545e-4a8b-af4c-f9d636155fc1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:45.181215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a9446c8-545e-4a8b-af4c-f9d636155fc1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1240 microversion: 2.1 time: 0.064289 May 10 20:24:45.181784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 492/974] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:45 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:45.875871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9b414ad-65c3-4fe7-b1f1-9801c07fbbc9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "POST /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.438500 May 10 20:24:45.876518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 483/975] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 20:24:44 2022] POST /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744/os-volume_attachments => generated 194 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:24:46.132201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:46.133501 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:46.140217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:46.140669 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:46.141441 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:46.141877 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:46.200910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:46.201610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:46.208288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:46.209136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:46.209937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:46.210379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:46.271839 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:46.274065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:46.279537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-35498eb9-65b2-414e-a897-5ac16d686af0 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.151229 May 10 20:24:46.280047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 493/976] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:46 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:46.281532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c99e5f18-0679-4927-9504-10f3ea88493f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1244 microversion: 2.1 time: 0.087118 May 10 20:24:46.282179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 484/977] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:46 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:47.297169 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:47.298027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:47.298682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:47.299127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:47.306609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:47.307280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:47.308118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:47.308535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:47.315625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:47.316089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:47.316894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:47.317339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:47.416632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:47.425030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6db1371-e8c5-440e-84b4-6102e95464aa tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1300 microversion: 2.1 time: 0.130755 May 10 20:24:47.428641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 485/978] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:47 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:47.472573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:47.480809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c3d932d4-0b5e-441d-aa9b-797e72711891 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.187980 May 10 20:24:47.481532 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 494/979] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:47 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:48.447739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:48.448473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:48.455424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:48.455874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:48.456661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:48.457098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:48.498186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:48.498821 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:48.505584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:48.506038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:48.506890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:48.507332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:48.639042 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:48.646491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-01bd8197-6461-4e91-9d03-3e923980ed76 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.152317 May 10 20:24:48.647059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 495/980] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:48 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:48.795948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:48.803286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa434965-f6e6-4223-a7bc-f535fb5453d1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.359549 May 10 20:24:48.804005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 486/981] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:48 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:49.236771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-1f986a43-aa57-41a9-83b2-365780ea8b25 req-b687e087-8148-4baa-9cad-677155e5a9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c370a2b-a8cd-4cbf-ba4c-48b870291ba3", "tag": "0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:49.248598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-1f986a43-aa57-41a9-83b2-365780ea8b25 req-b687e087-8148-4baa-9cad-677155e5a9e6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.249649 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-1f986a43-aa57-41a9-83b2-365780ea8b25 req-b687e087-8148-4baa-9cad-677155e5a9e6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:49.261819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-1f986a43-aa57-41a9-83b2-365780ea8b25 req-b687e087-8148-4baa-9cad-677155e5a9e6 service nova] Creating event network-changed:0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441 for instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 on hv-cinder-82880 May 10 20:24:49.268763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-1f986a43-aa57-41a9-83b2-365780ea8b25 req-b687e087-8148-4baa-9cad-677155e5a9e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 May 10 20:24:49.269920 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 496/982] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:49.525127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-e981bd18-08d3-4169-b587-44467a5ad968 req-e8c6402e-d90f-4c11-80ec-ccd05e0282f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11293c6a-e525-42a4-8bd3-a3c8bab24743", "name": "network-vif-plugged", "status": "completed", "tag": "474ff5fc-e7fe-4c60-a8a9-00898d145425"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:49.533335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-e981bd18-08d3-4169-b587-44467a5ad968 req-e8c6402e-d90f-4c11-80ec-ccd05e0282f6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.533788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-e981bd18-08d3-4169-b587-44467a5ad968 req-e8c6402e-d90f-4c11-80ec-ccd05e0282f6 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:49.545458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-e981bd18-08d3-4169-b587-44467a5ad968 req-e8c6402e-d90f-4c11-80ec-ccd05e0282f6 service nova] Creating event network-vif-plugged:474ff5fc-e7fe-4c60-a8a9-00898d145425 for instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 on hv-cinder-82880 May 10 20:24:49.550289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-e981bd18-08d3-4169-b587-44467a5ad968 req-e8c6402e-d90f-4c11-80ec-ccd05e0282f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 May 10 20:24:49.550890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 487/983] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:49.671830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:49.671830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:49.674377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.675097 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:49.676062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.676831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:49.819210 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:49.823463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:49.825944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:49.827346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-62f323da-6f61-4a1c-aabb-d310c1ec4a1e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.166305 May 10 20:24:49.827674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 497/984] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:49 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:49.834737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.836402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:49.837399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:49.838016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:50.036000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:50.044084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-39254c1f-3985-4077-b51c-4750e59be03e tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.227074 May 10 20:24:50.044663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 488/985] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:49 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:50.844733 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:50.845369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:50.853456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:50.853908 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:50.854711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:50.855162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:50.984067 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:50.991316 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19fe3d9f-c326-464f-9b59-4ac0f5dad51c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.150457 May 10 20:24:50.991878 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 498/986] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:50 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:51.061026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:51.061651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:51.068009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:51.068463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:51.069246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:51.069694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:51.203238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:51.210656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-24745a1d-3bef-4ac6-ae6f-bc5f94227e28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.153579 May 10 20:24:51.211924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 489/987] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:51 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:52.008727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:52.009866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:52.016208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:52.016661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:52.017437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:52.017875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:52.144352 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:52.151580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db9526f4-eb45-4d28-8eb6-7e4b9fb18f40 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1315 microversion: 2.1 time: 0.147449 May 10 20:24:52.152141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 499/988] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:52 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:52.227097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:52.227844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:52.234193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:52.235524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:52.236327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:52.236763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:52.364854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:52.372611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2feefb11-fc87-4e39-b366-ab0e6a4f52be tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.149424 May 10 20:24:52.373174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 490/989] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:52 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:53.168457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:53.169068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:53.175293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.175746 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.176516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.176957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.327527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:53.336950 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4a4d0cc2-0b71-4484-acb8-e2905224b967 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1464 microversion: 2.1 time: 0.172194 May 10 20:24:53.338003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 500/990] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:53 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:53.388660 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:53.388879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:53.389397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:53.389491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:53.396378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.397687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.398062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.398568 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.399522 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.399652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.400015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.401309 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.433772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:24:53.544343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:53.551517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6bc5c1ad-d8bd-4bbd-ad46-8f7783b3f5f1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.166685 May 10 20:24:53.555896 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 501/991] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:53 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:53.708197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a4926d85-f317-4a2f-995f-9521a065a6e2 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "DELETE /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 204 len: 0 microversion: 2.1 time: 0.315517 May 10 20:24:53.708197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 491/992] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:24:53 2022] DELETE /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:24:53.718110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:53.718110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:53.728234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.730681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.730681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:53.730681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:53.866605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:53.876359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-39b1a80b-9298-4aa8-a461-ddb7913ca44c tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1470 microversion: 2.1 time: 0.163484 May 10 20:24:53.876359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 502/993] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:53 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:54.569762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:54.570519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:54.577005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:54.577452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:54.578279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:54.578712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:54.824693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:54.832545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f06a4dfe-ab45-457a-afba-5c9db9e30661 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.267367 May 10 20:24:54.833118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 492/994] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:54 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:54.892445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:54.893052 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:54.899175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:54.899621 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:54.900388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:54.900906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.037574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:55.048628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-227c28c6-d464-433b-a479-7b96491823f4 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1470 microversion: 2.1 time: 0.160239 May 10 20:24:55.049279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 503/995] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:54 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:55.389749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:55.390273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:55.396172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.396627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.397395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.397886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.399175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-b674403f-e1d9-442c-b719-e3ded8b648be req-170d3333-8f3e-4deb-bff2-31d8a6335e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:55.407903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b674403f-e1d9-442c-b719-e3ded8b648be req-170d3333-8f3e-4deb-bff2-31d8a6335e14 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.408142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b674403f-e1d9-442c-b719-e3ded8b648be req-170d3333-8f3e-4deb-bff2-31d8a6335e14 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.420043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-b674403f-e1d9-442c-b719-e3ded8b648be req-170d3333-8f3e-4deb-bff2-31d8a6335e14 service nova] Creating event network-changed:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:24:55.425772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-b674403f-e1d9-442c-b719-e3ded8b648be req-170d3333-8f3e-4deb-bff2-31d8a6335e14 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030188 May 10 20:24:55.426821 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 504/996] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:55.431689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:24:55.716417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f12adef5-81b1-4c4c-83cc-40ee5ab3c2e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 204 len: 0 microversion: 2.1 time: 0.330211 May 10 20:24:55.717054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 493/997] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:24:55 2022] DELETE /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:24:55.726008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:55.726904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:55.732932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.733390 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.734199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.734642 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.850720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:55.856818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:55.857326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.857778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.858793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:55.859237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:55.876757 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:55.885046 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-517daca1-7504-4ff4-86a0-b8e9c621083b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.163250 May 10 20:24:55.885639 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 505/998] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:55.997262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:56.005143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a24da6f4-d9dd-493d-93f8-fbac4cf6ab99 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.158810 May 10 20:24:56.005881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 494/999] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:55 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:56.066841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:56.067461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:56.074830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:56.075286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:56.076080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:56.076523 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:56.207458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:56.215640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1277d77e-8241-4953-b4e3-f0be44e5cb19 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1470 microversion: 2.1 time: 0.152699 May 10 20:24:56.216219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 506/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:56 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:56.902700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:56.903328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:56.909833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:56.910329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:56.911116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:56.911558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.027526 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:57.028244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:57.034221 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:57.034737 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.035573 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:57.036077 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.047379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:57.055625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7a729fa-76f6-47d9-9630-ece91e49153c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.156378 May 10 20:24:57.056334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 495/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:57.169001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:57.176564 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a922b1b5-6748-4009-a6a3-694d938edca9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.153036 May 10 20:24:57.177128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 507/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:57 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:57.233208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:57.233820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:57.239870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:57.240123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.240922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:57.241357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.344356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-27838354-36da-47c8-a4dd-385767bfa6ff req-be723bca-65ee-4a9f-8e87-e161d4fb927c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c370a2b-a8cd-4cbf-ba4c-48b870291ba3", "name": "network-vif-plugged", "status": "completed", "tag": "0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:57.353098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-27838354-36da-47c8-a4dd-385767bfa6ff req-be723bca-65ee-4a9f-8e87-e161d4fb927c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:57.353546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-27838354-36da-47c8-a4dd-385767bfa6ff req-be723bca-65ee-4a9f-8e87-e161d4fb927c service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:57.370189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-27838354-36da-47c8-a4dd-385767bfa6ff req-be723bca-65ee-4a9f-8e87-e161d4fb927c service nova] Creating event network-vif-plugged:0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441 for instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 on hv-cinder-82880 May 10 20:24:57.370189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-27838354-36da-47c8-a4dd-385767bfa6ff req-be723bca-65ee-4a9f-8e87-e161d4fb927c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028878 May 10 20:24:57.370189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 508/1003] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:57.374034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:57.381447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-09e6c63e-a14c-4a76-9bc7-723c5bbedbb3 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1470 microversion: 2.1 time: 0.152163 May 10 20:24:57.382012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 496/1004] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:57 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:58.073836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:58.074565 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:58.081434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.081970 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.082772 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.083206 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.194157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:58.194779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:58.201698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.202190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.202972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.203414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.253199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:58.268974 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-434ff5c7-9812-47a7-9f78-0ed5689c6db2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1569 microversion: 2.1 time: 0.199747 May 10 20:24:58.269972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 509/1005] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:58.398357 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:58.398929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:58.399149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:58.405088 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.405622 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.406198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88c6659f-2e76-43e4-9dc9-c27db2f56444 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.215985 May 10 20:24:58.406714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:58.406946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 497/1006] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:58 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:58.407210 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:58.666185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:58.674717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-59f10b41-6d39-4615-9573-82951d874908 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1470 microversion: 2.1 time: 0.280249 May 10 20:24:58.679615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 510/1007] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:58 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:24:59.149143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-719ace59-a7e6-45f0-9c22-5ddb4c62b821 req-c2179f97-c8e9-4f17-bb6c-c8501541e146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11293c6a-e525-42a4-8bd3-a3c8bab24743", "name": "network-vif-deleted", "tag": "474ff5fc-e7fe-4c60-a8a9-00898d145425"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:24:59.157566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-719ace59-a7e6-45f0-9c22-5ddb4c62b821 req-c2179f97-c8e9-4f17-bb6c-c8501541e146 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.158660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-719ace59-a7e6-45f0-9c22-5ddb4c62b821 req-c2179f97-c8e9-4f17-bb6c-c8501541e146 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.175321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-719ace59-a7e6-45f0-9c22-5ddb4c62b821 req-c2179f97-c8e9-4f17-bb6c-c8501541e146 service nova] Creating event network-vif-deleted:474ff5fc-e7fe-4c60-a8a9-00898d145425 for instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 on hv-cinder-82880 May 10 20:24:59.180530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-719ace59-a7e6-45f0-9c22-5ddb4c62b821 req-c2179f97-c8e9-4f17-bb6c-c8501541e146 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 May 10 20:24:59.181537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 498/1008] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:24:59.287008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:59.287412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:59.293658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.294134 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.294954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.295400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.357000 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:59.364343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-53ba8d6c-c198-4578-bf30-9803c16a8718 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1383 microversion: 2.1 time: 0.081678 May 10 20:24:59.364912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 511/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1383 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:59.423943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:59.424645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:59.432010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.432463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.433252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.433688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.578504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:59.587955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5485b09d-be6c-4eb4-abd6-0d03107d2b46 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1366 microversion: 2.1 time: 0.168355 May 10 20:24:59.588695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 499/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:59 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:24:59.692722 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:24:59.693464 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:24:59.700486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.700941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.701725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.702188 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.735383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:24:59.735836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:24:59.736292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lazy-loading 'fault' on Instance uuid 11293c6a-e525-42a4-8bd3-a3c8bab24743 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:24:59.776424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:24:59.783818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-497cc34c-70a5-4658-93a3-f82525a2e2c9 tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1305 microversion: 2.1 time: 0.094931 May 10 20:24:59.784388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 512/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:24:59 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:00.380621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:00.381291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:00.387262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.387712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.388484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.388926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.452975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:00.460648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-598a3fa7-afd5-4c97-aabc-54cd2dadc9a7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083839 May 10 20:25:00.461721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 500/1012] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:00.605529 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:00.606161 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:00.612364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.612820 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.613587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.614025 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.743546 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:00.750933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8a209fa8-dd81-4496-a688-b4a2bf25e61b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1555 microversion: 2.1 time: 0.149902 May 10 20:25:00.751585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 513/1013] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:00 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:00.768220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:00.768753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:00.775243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.775689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.776466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.776908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.806984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:00.807714 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:00.813807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.814398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.815188 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.815628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.853934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:00.854335 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:00.854789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lazy-loading 'fault' on Instance uuid 11293c6a-e525-42a4-8bd3-a3c8bab24743 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:25:00.862063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb8be0eb-0331-476c-879b-31051a3eee2c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097797 May 10 20:25:00.862909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 501/1014] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:25:00 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:00.896862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e4e9e74776483dbb264db2dd26bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5515c98d19e4d53b195f1d190997208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:00.904944 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b6b8eb06-01fc-4ab4-8250-3fd5e681783e tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 200 len: 1305 microversion: 2.1 time: 0.101778 May 10 20:25:00.905760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 514/1015] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:00 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:25:01.393952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-64f9988d-7ee5-48a1-8cb2-a96757a2bf76 req-b8d89400-99bf-4fda-b211-b1d95b960738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddf4267-70b6-417f-b6de-6873fb9117a4", "name": "network-vif-deleted", "tag": "7493a0cb-9315-4b94-8686-f58a23c9417d"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:25:01.402147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-64f9988d-7ee5-48a1-8cb2-a96757a2bf76 req-b8d89400-99bf-4fda-b211-b1d95b960738 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:01.402602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-64f9988d-7ee5-48a1-8cb2-a96757a2bf76 req-b8d89400-99bf-4fda-b211-b1d95b960738 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:01.413553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-64f9988d-7ee5-48a1-8cb2-a96757a2bf76 req-b8d89400-99bf-4fda-b211-b1d95b960738 service nova] Creating event network-vif-deleted:7493a0cb-9315-4b94-8686-f58a23c9417d for instance 2ddf4267-70b6-417f-b6de-6873fb9117a4 on hv-cinder-82880 May 10 20:25:01.418429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-64f9988d-7ee5-48a1-8cb2-a96757a2bf76 req-b8d89400-99bf-4fda-b211-b1d95b960738 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028174 May 10 20:25:01.419367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 502/1016] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:01.477312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:01.478075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:01.483988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:01.484440 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:01.485220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:01.485665 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:01.551860 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:01.560306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-00a97533-fb0d-491a-8ab4-01078583b8c5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.087425 May 10 20:25:01.560880 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 515/1017] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:01.923406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:01.924238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] [instance: 11293c6a-e525-42a4-8bd3-a3c8bab24743] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:01.930114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:01.930570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:01.931440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:01.931875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:01.944893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] HTTP exception thrown: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Request method failure captured: May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 HTTP/1.1 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoC2ddb-38Z47Y22R_DDVSUk651bGa26uFeT0rlFnQSDcc8qzbLJe7UlNf_W1uMzWab46iS3nsPtnFOAOvqUNXkMaD48AkX346Y6jm8rVGJQ3PYoRqdqZe2_Z1AVCPvAjiAwaRp8nVhfA4qb361-2-FCBtmpIVEzUyW5j782xbArMs May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: b5515c98d19e4d53b195f1d190997208 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-970415069 May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:25:01.946611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b5515c98d19e4d53b195f1d190997208"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b5515c98d19e4d53b195f1d190997208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b5515c98d19e4d53b195f1d190997208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b5515c98d19e4d53b195f1d190997208", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-970415069 May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: b5515c98d19e4d53b195f1d190997208 May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-970415069 May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-970415069-project May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: e5e4e9e74776483dbb264db2dd26bd17 May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-970415069-project May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. May 10 20:25:01.948333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '11293c6a-e525-42a4-8bd3-a3c8bab24743'} May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:25:01.949333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. May 10 20:25:01.950954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:25:01.952369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] Returning 404 to user: Instance 11293c6a-e525-42a4-8bd3-a3c8bab24743 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:25:01.952369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b09c144b-8fdd-47be-994b-c955944116af tempest-VolumesNegativeTest-970415069 tempest-VolumesNegativeTest-970415069-project] 10.222.0.65 "GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743" status: 404 len: 111 microversion: 2.1 time: 0.029723 May 10 20:25:01.952369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 503/1018] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:01 2022] GET /compute/v2.1/servers/11293c6a-e525-42a4-8bd3-a3c8bab24743 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:25:02.577213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:02.577841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:02.584433 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:02.584887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:02.585670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:02.586763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:02.650644 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:02.658597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2a3b155a-8d05-436d-86e2-524e8394d7f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085133 May 10 20:25:02.659239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 516/1019] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:03.449268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-22741ae6-3620-4342-aa99-40d9b702bed4 req-4cf78995-8109-4eb7-abf7-dcb5d0a51bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c370a2b-a8cd-4cbf-ba4c-48b870291ba3", "tag": "0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:25:03.457757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-22741ae6-3620-4342-aa99-40d9b702bed4 req-4cf78995-8109-4eb7-abf7-dcb5d0a51bae service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:03.458234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-22741ae6-3620-4342-aa99-40d9b702bed4 req-4cf78995-8109-4eb7-abf7-dcb5d0a51bae service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:03.468874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-22741ae6-3620-4342-aa99-40d9b702bed4 req-4cf78995-8109-4eb7-abf7-dcb5d0a51bae service nova] Creating event network-changed:0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441 for instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 on hv-cinder-82880 May 10 20:25:03.473734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-22741ae6-3620-4342-aa99-40d9b702bed4 req-4cf78995-8109-4eb7-abf7-dcb5d0a51bae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028612 May 10 20:25:03.474311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 504/1020] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:03.675527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:03.676775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:03.683606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:03.687873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:03.687873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:03.687873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:03.752116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:03.759717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7607184c-2f10-4a43-a452-4f2d3dbcb5de tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088055 May 10 20:25:03.760427 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 517/1021] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:04.777685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:04.778500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:04.784717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:04.785166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:04.785936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:04.786399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:04.848785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:04.856503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c91e5f8-113d-4a0f-9857-01f54658856d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084135 May 10 20:25:04.857106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 505/1022] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:04 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:05.872918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:05.873515 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:05.879814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:05.880267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:05.881040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:05.881485 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:05.941489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:05.949057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f0dd022f-e2cc-4652-8cdc-2fc0f2a6a5fd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080083 May 10 20:25:05.949726 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 518/1023] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:06.965300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:06.965918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:06.972334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:06.972782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:06.973554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:06.973992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:07.035773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:07.043860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2bd8c583-c4e1-4a23-8896-6e2998245f20 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082466 May 10 20:25:07.044434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 506/1024] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:06 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:08.061135 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:08.061749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:08.068211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:08.068664 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:08.069436 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:08.069875 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:08.129383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:08.137505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f4a700bd-0c48-49e7-8cd1-b7840e7954ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080212 May 10 20:25:08.138074 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 519/1025] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:09.155424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:09.156059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:09.167801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:09.168250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:09.169037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:09.169477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:09.232866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:09.240135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f3c562ed-2370-422b-b777-ecd3f37704d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088735 May 10 20:25:09.240712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 507/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:09 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:10.256862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:10.257483 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:10.263837 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:10.264284 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:10.265057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:10.265497 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:10.324343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:10.331845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-307b9acd-5727-46d2-8bdd-a66076afcd02 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078872 May 10 20:25:10.332419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 520/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:11.348120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:11.348739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:11.355086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:11.355542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:11.356346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:11.356791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:11.416224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:11.423539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c5fb827d-b0f0-44f1-81d2-8a051774efa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079476 May 10 20:25:11.424108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 508/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:11 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:12.440098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:12.440718 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:12.447078 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:12.447527 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:12.448300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:12.448740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:12.509535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:12.516760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d93edd9a-99a3-4dc8-abfd-64b7868a06c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080489 May 10 20:25:12.517268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 521/1029] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:13.533963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:13.534844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:13.541944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:13.542354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:13.543122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:13.543550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:13.606043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:13.613224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad02e5a0-9ce9-47b5-a45a-ce08e659c634 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083270 May 10 20:25:13.613786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 509/1030] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:13 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:14.629940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:14.630593 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:14.637636 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:14.638097 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:14.638868 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:14.639362 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:14.699004 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:14.706756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7b193f2d-26d0-4db4-bda4-cfc1bd7e7947 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080622 May 10 20:25:14.707325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 522/1031] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:15.723646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:15.724214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:15.731223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:15.731666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:15.732568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:15.733000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:15.793287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:15.800919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-203888ac-114b-48df-93ad-7a14a5e052f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081167 May 10 20:25:15.809869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 510/1032] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:15 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:16.816852 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:16.817375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:16.823825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:16.824271 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:16.825049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:16.825489 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:16.893618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:16.901939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d286c4c8-0c1d-4630-b204-c6459e7f8b6d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.089075 May 10 20:25:16.902534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 523/1033] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:16 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:17.918962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:17.919582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:17.926058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:17.926530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:17.927302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:17.927738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:17.987720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:17.995015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c3e51fcc-b65a-417c-bd08-5497690d3046 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080688 May 10 20:25:17.995590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 511/1034] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:19.011548 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:19.012168 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:19.018457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:19.018912 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:19.019688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:19.020130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:19.080841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:19.088695 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-705ccd0b-5897-414e-97f2-1e193b4b2f38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080947 May 10 20:25:19.089253 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 524/1035] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:20.105700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:20.106345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:20.112673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:20.113130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:20.113903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:20.114369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:20.178654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:20.186061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2684dccf-6ce6-4257-be6d-c53e6919bb38 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084799 May 10 20:25:20.186654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 512/1036] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:21.202589 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:21.203218 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:21.209847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:21.210334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:21.211115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:21.211561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:21.272884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:21.280320 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-57527909-8930-4079-956d-59930fac56d5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081577 May 10 20:25:21.280885 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 525/1037] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:21 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:22.296721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:22.297320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:22.303624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:22.304066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:22.305350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:22.305930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:22.364774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:22.372488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9202c224-1e3b-4732-a2fc-3f1875833054 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079686 May 10 20:25:22.373044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 513/1038] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:23.389058 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:23.389596 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:23.396002 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:23.396468 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:23.397246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:23.397687 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:23.459823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:23.467240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2c124331-d28d-48d6-9e4f-7973006ee00e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082202 May 10 20:25:23.467888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 526/1039] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:23 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:24.483843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:24.484454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:24.490867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:24.491309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:24.492568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:24.493054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:24.566116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:24.574530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-837a20cf-04a0-44b6-8b1d-66dd2c566d53 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.094338 May 10 20:25:24.575149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 514/1040] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:24 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:25.592562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:25.593105 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:25.599506 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:25.600053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:25.600921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:25.601431 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:25.662282 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:25.670219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-86a2eaa6-b93f-4ed0-9b6c-b973ab361a17 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081792 May 10 20:25:25.680493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 527/1041] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:25 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:26.688052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:26.690808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:26.694701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:26.695143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:26.695906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:26.696346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:26.756859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:26.764395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35a07499-bea7-4f29-a6dc-b761c0015ee6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080326 May 10 20:25:26.764967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 515/1042] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:26 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:27.783802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:27.784421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:27.791496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:27.791949 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:27.792727 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:27.793162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:27.854359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:27.861609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6db2da23-2888-447d-9779-7d81d2c83a8f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081689 May 10 20:25:27.862204 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 528/1043] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:27 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:28.878976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:28.879597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:28.885922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:28.886418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:28.887197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:28.887636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:28.949579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:28.957752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a3de0fa-c083-42a5-acea-5ccb95359a96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082669 May 10 20:25:28.958378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 516/1044] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:28 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:29.975375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:29.975966 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:29.982936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:29.983384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:29.984154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:29.984591 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:30.046723 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:30.053986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6fb315d5-1d4b-43fa-baf3-2ea347b0fde2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082511 May 10 20:25:30.055202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 529/1045] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:29 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:31.071530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:31.072147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:31.078749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:31.079201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:31.080272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:31.080711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:31.140794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:31.154270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6451be06-7f90-4009-ab0d-2b5dc56af27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080695 May 10 20:25:31.154270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 517/1046] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:32.165395 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:32.166047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:32.172583 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:32.173036 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:32.173822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:32.174314 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:32.235556 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:32.242898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-72b9d1a4-3daa-43f7-88ab-92ef898c0363 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082009 May 10 20:25:32.243636 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 530/1047] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:32 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:33.258827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:33.259441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:33.265689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:33.266158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:33.266924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:33.267354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:33.326463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:33.333903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e7f08b3-24f4-4991-9d49-d0567be9c426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078935 May 10 20:25:33.334507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 518/1048] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:34.351129 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:34.352407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:34.358761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:34.359208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:34.359971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:34.360410 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:34.419539 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:34.426906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8740b926-08c9-468a-a30f-f5b4b4e78b4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079651 May 10 20:25:34.427491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 531/1049] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:35.443559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:35.444177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:35.451097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:35.455564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:35.455564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:35.455564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:35.514524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:35.521729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0c69c7d7-4d69-492f-86a3-b91dc4cb544b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082030 May 10 20:25:35.522327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 519/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:36.539047 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:36.539552 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:36.545882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:36.546366 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:36.547142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:36.547583 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:36.611768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:36.619652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a092519c-2d39-4e79-858f-ddc5544f12c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084619 May 10 20:25:36.620217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 532/1051] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:36.982201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:36.982759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:36.989015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:36.989518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:36.990395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:36.990841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:37.013839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a1d8c998-488e-45b6-aee4-1e6b71bac2b7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3/ips" status: 200 len: 148 microversion: 2.1 time: 0.035515 May 10 20:25:37.014435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 520/1052] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:25:36 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:37.635609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:37.636230 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:37.642706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:37.644815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:37.644815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:37.644815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:37.707499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:37.723493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-adad22aa-0f93-4e1f-9d23-44a7ee31e53a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.091618 May 10 20:25:37.724279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 533/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:38.740726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:38.741370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:38.748303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:38.748750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:38.749521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:38.749958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:38.812534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:38.819861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ea39bc2d-dd2e-4f6f-a0ea-6f8db43d3c8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083109 May 10 20:25:38.821080 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 521/1054] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:38 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:39.837724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:39.838283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:39.844550 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:39.844993 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:39.845762 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:39.846226 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:40.175592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:40.183610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-080c7c18-edad-4a0e-80ef-24e8bfb68d14 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.350494 May 10 20:25:40.184178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 534/1055] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:41.200470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:41.201041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:41.207620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:41.208067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:41.208847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:41.209281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:41.272415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:41.280566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a1150b2a-f98a-4e70-bfc8-87ebac831ebe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084075 May 10 20:25:41.281132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 522/1056] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:42.296723 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:42.297285 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:42.303486 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:42.303934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:42.305312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:42.305749 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:42.365118 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:42.372321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-56c207dc-8af0-4361-b477-79c8f6c07a47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079516 May 10 20:25:42.372889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 535/1057] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:43.389630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:43.390186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:43.396580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:43.397030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:43.397803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:43.398290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:43.458369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:43.465778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-11b97874-7319-4289-bd70-bfd26efb7419 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080120 May 10 20:25:43.466385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 523/1058] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:44.482923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:44.483536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:44.489802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:44.490288 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:44.491055 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:44.491492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:44.550454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:44.558227 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-67ebf5ac-4c61-467e-bce7-f465495eeb0d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079167 May 10 20:25:44.558784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 536/1059] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:45.575612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:45.576236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:45.583087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:45.583543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:45.584317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:45.584758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:45.644014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:45.651312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e927fe55-1f0f-4261-986a-9cec5c39b560 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079637 May 10 20:25:45.651880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 524/1060] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:46.668382 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:46.668999 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:46.675338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:46.675795 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:46.676575 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:46.677017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:46.737592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:46.745921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19818f92-2779-42aa-bfb7-01d720bc8708 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081391 May 10 20:25:46.746756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 537/1061] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:47.763865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:47.764432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:47.770854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:47.771307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:47.772075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:47.772517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:47.831787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:47.839218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-87a8b0c6-fd24-4ba5-96e2-d440b7e788bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079300 May 10 20:25:47.839788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 525/1062] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:48.855842 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:48.856459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:48.862857 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:48.863307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:48.864075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:48.864510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:48.926704 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:48.934411 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-45103dde-107e-4193-9004-d66530d021b8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082404 May 10 20:25:48.939319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 538/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:49.954390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:49.955254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:49.961441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:49.962027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:49.962832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:49.963265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:50.023967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:50.031263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-94c8cefa-6bec-4a9b-905a-a9eb1276c2ad tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080667 May 10 20:25:50.031831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 526/1064] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:51.047630 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:51.048241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:51.055446 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:51.066049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:51.066049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:51.066049 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:51.116887 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:51.124938 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d977fa61-0c75-4f2e-85dc-72cb4983e01b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081166 May 10 20:25:51.125518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 539/1065] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:52.140623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:52.141243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:52.147569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:52.148021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:52.148792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:52.149232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:52.212694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:52.220063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3942f8d2-3774-44c7-a4f7-6ea18512eaaf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083298 May 10 20:25:52.220637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 527/1066] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:53.236809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:53.237365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:53.243786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:53.244230 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:53.244991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:53.245424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:53.304353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:53.311862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cd26e5f4-8bfc-4760-9246-4bc6350c540f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078996 May 10 20:25:53.312472 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 540/1067] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:53 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:54.328370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:54.328903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:54.335497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:54.335954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:54.337243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:54.337683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:54.406831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:54.414327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e15b7b40-bb8a-451d-8057-79ce73a318ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.089890 May 10 20:25:54.415485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 528/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:55.432108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:55.432725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:55.438769 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:55.439306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:55.440090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:55.440531 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:55.502066 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:55.509348 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f5a1f350-20f4-4f8e-9d28-cf8ab90eb238 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081564 May 10 20:25:55.509915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 541/1069] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:56.525934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:56.526613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:56.532816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:56.533264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:56.534039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:56.534515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:56.601417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:56.613486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6e5eeaf2-99d6-4006-be71-da21886221f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.091392 May 10 20:25:56.614072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 529/1070] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:57.630163 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:57.630785 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:57.637677 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:57.638154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:57.638931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:57.639372 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:57.701266 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:57.710108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ade9b145-ec12-4ef4-ab3e-3b7abaf1dc9f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083745 May 10 20:25:57.710701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 542/1071] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:58.726841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:58.734043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:58.734585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:58.735034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:58.735812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:58.736241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:58.798861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:58.806690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68b9eb6c-155f-4fd3-9e33-9e0813ff5561 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083779 May 10 20:25:58.807284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 530/1072] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:25:59.830347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:59.830347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:25:59.830873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:59.830873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:59.831730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:59.832177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:59.892006 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:25:59.899927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c22ef60e-5abd-451d-a934-4ee54b9a4b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080632 May 10 20:25:59.900499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 543/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:25:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:00.916902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:00.917519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:00.923856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:00.924310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:00.925082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:00.925526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:00.985281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:00.992510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68b38888-9a95-4c0a-8f0d-74ac8fc1e5af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080033 May 10 20:26:00.993687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 531/1074] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:02.010425 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:02.010980 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:02.017369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:02.017823 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:02.018637 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:02.019079 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:02.078311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:02.085859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-781cfdcf-44e7-4109-b95a-d008c4b78659 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080075 May 10 20:26:02.086483 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 544/1075] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:03.101735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:03.102863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:03.109090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:03.109536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:03.110331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:03.110769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:03.173915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:03.182059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e0500413-18da-4b6c-88b0-cd021fc8e2c8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084161 May 10 20:26:03.182838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 532/1076] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:04.199454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:04.200065 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:04.206639 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:04.207110 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:04.207855 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:04.208321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:04.267235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:04.274699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d0bdcf24-ea43-414e-b2d3-4da5e853a3f0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079607 May 10 20:26:04.275178 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 545/1077] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:04 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:05.296213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:05.296829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:05.303234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:05.303683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:05.304459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:05.304887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:05.382458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:05.392944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8ad0d592-8056-458b-9028-f879c3a1904e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.100197 May 10 20:26:05.393981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 533/1078] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:06.409791 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:06.410369 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:06.418520 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:06.418989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:06.420888 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:06.421347 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:06.484959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:06.492216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8aeadf17-7a03-4aa6-867f-3f958db40061 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086379 May 10 20:26:06.492792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 546/1079] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:06 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:07.508442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:07.509059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:07.515416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:07.515863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:07.516631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:07.517068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:07.576562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:07.584097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4f133381-45b1-4186-b604-dcd31dafc041 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079518 May 10 20:26:07.584664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 534/1080] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:07 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:08.600586 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:08.601205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:08.607543 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:08.607997 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:08.608773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:08.609211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:08.670149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:08.677373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-68ee2b1d-e044-4ba8-9fe6-65d083faaf64 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080699 May 10 20:26:08.677935 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 547/1081] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:09.694511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:09.695132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:09.701979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:09.702478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:09.703257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:09.703703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:09.763706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:09.770921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-12b5e4de-1bc5-4e8a-a3e9-f466dd706840 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080284 May 10 20:26:09.771495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 535/1082] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:09 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:10.788138 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:10.788746 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:10.795155 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:10.795597 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:10.796358 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:10.796787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:10.855741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:10.862972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-45e362bb-e31b-4530-b970-eb90e49de4ab tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078681 May 10 20:26:10.863536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 548/1083] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:11.879868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:11.880489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:11.886898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:11.887352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:11.888124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:11.888563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:11.951175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:11.958739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80068f54-6d3f-4402-93e8-4502dfbe34a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082741 May 10 20:26:11.959310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 536/1084] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:11 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:12.976030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:12.976628 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:12.982933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:12.983405 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:12.984162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:12.984605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:13.043638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:13.050906 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-575863d1-cfb3-4e26-aa5c-a2f30dc0144f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078866 May 10 20:26:13.051476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 549/1085] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:14.068080 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:14.068703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:14.075793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:14.076254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:14.077040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:14.077483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:14.138970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:14.146301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5099172c-e3ed-420c-94ff-2130c5332774 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082047 May 10 20:26:14.146867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 537/1086] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:15.163142 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:15.163671 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:15.169972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:15.170448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:15.171213 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:15.171675 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:15.234284 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:15.241624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-054c1992-f9e9-4d45-ae69-ebb1945fb234 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082565 May 10 20:26:15.242212 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 550/1087] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:15 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:16.258185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:16.258792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:16.265152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:16.265605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:16.266410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:16.266850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:16.325806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:16.333601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3a820756-a696-4b0b-b831-e5ca2f362b1a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079305 May 10 20:26:16.334122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 538/1088] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:16 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:17.350647 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:17.351268 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:17.358098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:17.358567 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:17.359344 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:17.359787 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:17.420576 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:17.428171 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c66630c0-4276-4925-97fb-7dbb6d48c29b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081380 May 10 20:26:17.428845 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 551/1089] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:18.444670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:18.445372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:18.452446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:18.452892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:18.453659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:18.454117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:18.516362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:18.523713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-15cceeee-d0b5-45bf-ac5f-62e90f2f2fb1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082930 May 10 20:26:18.524276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 539/1090] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:18 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:19.539674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:19.540294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:19.546618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:19.547073 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:19.547848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:19.548292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:19.608518 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:19.615859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7a958e01-9efa-4e02-ac2e-224ead0d525e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080032 May 10 20:26:19.616432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 552/1091] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:20.632252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:20.632861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:20.639207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:20.639652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:20.640413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:20.640843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:20.703020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:20.710725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec4fa6ac-5c39-459b-ac19-49bf804e341e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082301 May 10 20:26:20.711407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 540/1092] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:21.728789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:21.729398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:21.735780 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:21.736225 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:21.736992 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:21.737422 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:21.797986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:21.805435 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-47d9c579-5068-4078-a99f-b8982715c826 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081206 May 10 20:26:21.806668 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 553/1093] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:21 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:22.822453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:22.823128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:22.829314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:22.830031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:22.830831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:22.831275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:22.895847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:22.901315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a9098439-96a4-427b-a162-82c12f0d04ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082666 May 10 20:26:22.901882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 541/1094] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:23.918934 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:23.919555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:23.925922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:23.926412 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:23.927193 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:23.927638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:23.992022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:23.999919 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0f8428dc-0f6e-4a3e-bf4e-6820d390611e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085487 May 10 20:26:24.000491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 554/1095] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:23 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:25.016263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:25.016876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:25.023178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:25.023673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:25.025107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:25.025542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:25.085010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:25.092227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-998da78a-5096-4336-9793-07ee1751dd8a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079775 May 10 20:26:25.092793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 542/1096] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:25 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:26.109250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:26.109860 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:26.115724 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:26.116174 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:26.116941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:26.117375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:26.183101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:26.190584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0961f80d-3b7c-41bc-afd7-cddb9cd92a59 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085278 May 10 20:26:26.191152 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 555/1097] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:26 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:27.208194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:27.208813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:27.215301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:27.215751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:27.216529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:27.216967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:27.276828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:27.284084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5acfc9de-fac6-4273-bfb4-a6a5e6239da9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080196 May 10 20:26:27.284666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 543/1098] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:27 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:28.300783 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:28.301408 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:28.307788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:28.308240 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:28.309011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:28.309458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:28.368738 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:28.376091 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-852dc7be-d266-4b89-aaef-5d5200801139 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079228 May 10 20:26:28.376656 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 556/1099] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:28 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:29.393286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:29.393828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:29.400206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:29.400656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:29.401425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:29.401861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:29.464769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:29.472134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8adca926-d3ee-462b-8aa5-ccce78d48245 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082794 May 10 20:26:29.472706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 544/1100] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:29 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:30.490765 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:30.491312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:30.498204 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:30.498655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:30.499416 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:30.499847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:30.560038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:30.567298 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e7d44bd8-5366-4797-aeb6-7415681abf7f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080431 May 10 20:26:30.567876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 557/1101] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:30 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:31.585118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:31.585667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:31.592853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:31.593304 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:31.594076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:31.594544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:31.653978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:31.661231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9599f7a-1563-46e5-a970-76a59d69f323 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080117 May 10 20:26:31.661807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 545/1102] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:32.678141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:32.678690 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:32.685269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.688986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.688986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.688986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.751117 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:32.758515 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-92da88bb-e7af-47ff-afd8-1f55f14d21d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084312 May 10 20:26:32.759076 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 558/1103] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:32 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:33.775805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:33.776424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:33.782805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:33.783257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:33.784029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:33.784469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:33.847410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:33.853701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bbdcd166-fef1-4b59-b021-35f9bfbe353c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082326 May 10 20:26:33.854311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 546/1104] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:34.870528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:34.871173 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:34.877465 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:34.877918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:34.878721 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:34.879159 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:34.938895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:34.946154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d61af327-819a-43bd-a6be-a2660f28096b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079466 May 10 20:26:34.951235 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 559/1105] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:35.963338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:35.963984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:35.970381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:35.970832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:35.971606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:35.972045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:36.031160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:36.038451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-032fc17f-6683-45ec-a8e0-cb1ecb9d0b47 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079022 May 10 20:26:36.039025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 547/1106] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:37.056418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:37.057063 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:37.063365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:37.063818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:37.064585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:37.065024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:37.124511 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:37.131715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-280dd80b-99c1-4849-9cbc-6aed76693554 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079811 May 10 20:26:37.132283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 560/1107] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:38.148295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:38.148908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:38.155732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:38.156212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:38.156979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:38.157416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:38.269100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:38.277006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a2de2ec-2117-4112-b37a-7a9e35d1d83d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.132594 May 10 20:26:38.277581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 548/1108] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:38 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:39.294167 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:39.294776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:39.300984 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:39.301426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:39.302217 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:39.302654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:39.364068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:39.371329 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ac391b9d-cb25-4944-ab84-ac69d9d489d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081549 May 10 20:26:39.372075 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 561/1109] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:40.387910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:40.388550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:40.394872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:40.395323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:40.396095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:40.396537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:40.457448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:40.465528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-66270439-dc13-47b3-8dbd-66564420e07a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081546 May 10 20:26:40.466105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 549/1110] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:41.487151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:41.487151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:41.490577 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:41.491111 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:41.491968 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:41.492490 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:41.623286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:41.630635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2395b42c-6e8a-4979-95b8-c3e07b9b848a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.151758 May 10 20:26:41.631239 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 562/1111] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:26:42.647852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:42.648539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:42.655478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:42.655915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:42.656673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:42.657104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:42.719115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:42.726671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-608ed98a-4f3c-415b-8024-f2fe4e22f763 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082703 May 10 20:26:42.727281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 550/1112] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:43.744522 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:43.745054 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:43.750994 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:43.751434 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:43.752199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:43.752743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:43.815296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:43.822923 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ab93a58b-bf99-482b-8187-71dbbfab4291 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083354 May 10 20:26:43.823494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 563/1113] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:44.840215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:44.840823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:44.846900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:44.847346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:44.848111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:44.848546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:44.910869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:44.919043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c79521f3-04fa-4fa6-b860-088a421c3244 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082766 May 10 20:26:44.919629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 551/1114] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:45.940652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:45.941232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:45.947662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:45.948189 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:45.948951 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:45.949384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:46.009793 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:46.017103 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5f9688d4-9323-4a4c-b2c0-4a0a484f7efd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080384 May 10 20:26:46.017664 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 564/1115] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:47.033680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:47.034324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:47.040528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:47.040976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:47.041749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:47.042198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:47.100995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:47.108458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5185a3bc-d17d-4559-9e42-536ccef80831 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078595 May 10 20:26:47.109044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 552/1116] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:48.124766 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:48.125379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:48.131641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:48.132092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:48.132859 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:48.133368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:48.193001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:48.200354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fafe665b-bd50-404d-b554-98718a22ce21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079437 May 10 20:26:48.200926 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 565/1117] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:49.216722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:49.217348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:49.223924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:49.224377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:49.225153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:49.225595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:49.286531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:49.293726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bc8eb3d8-c588-4aae-943a-391fb3684bd7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080896 May 10 20:26:49.294335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 553/1118] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:50.309755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:50.310398 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:50.316978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:50.317437 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:50.318242 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:50.318686 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:50.380937 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:50.388748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-559242dd-eff2-4a91-ab23-a13d48603b6a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082899 May 10 20:26:50.389322 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 566/1119] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:50 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:50.973791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:26:50.974317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:26:51.405078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:51.405612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:51.412024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:51.412474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:51.413240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:51.413678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:51.477269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:51.484743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-66cf06e1-539c-4510-9f8b-97cff92125f2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083581 May 10 20:26:51.485308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 554/1120] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:52.501723 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:52.502339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:52.508703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:52.509159 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:52.509932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:52.510396 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:52.572107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:52.579696 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5950860a-b9c1-496b-bb0f-c482d2d9c74d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081490 May 10 20:26:52.580274 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 567/1121] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:53.596377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:53.597028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:53.603371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:53.603827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:53.604595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:53.605035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:53.664499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:53.671939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d41a314f-52c0-47af-bba5-216f22219062 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079469 May 10 20:26:53.672504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 555/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:53 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:54.689507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:54.727536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:54.727536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:54.727536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:54.727536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:54.728897 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:54.762634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:54.769869 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-31137046-33f2-4f4d-a260-b4372ca6609b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084343 May 10 20:26:54.775005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 568/1123] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:55.786941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:55.787552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:55.793985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:55.794464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:55.795236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:55.795672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:55.855857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:55.863149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f993e3f7-dcfa-4ccb-80f6-9562513ff6a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080220 May 10 20:26:55.863713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 556/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:56.015259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:26:56.015438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:26:56.218056 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:26:56.218598 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Tue May 10 20:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:26:56.879928 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:56.880537 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:56.887185 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:56.887640 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:56.888407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:56.888841 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:56.953957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:56.961524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-da261da1-aabd-4067-88c4-1908012cc15d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085469 May 10 20:26:56.962108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 569/1125] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:57.978156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:57.978764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:57.985162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:57.985611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:57.986407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:57.986846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:58.057854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:58.068783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c90c5165-5b11-4031-b08a-82d53e8f92bc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.094532 May 10 20:26:58.069360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 557/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:26:59.087350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:26:59.087963 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:26:59.094248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:59.094688 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:59.095455 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:59.095890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:59.158989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:26:59.166895 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9207d917-cec6-45ad-8f2f-dd84a9b80e05 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084030 May 10 20:26:59.167458 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 570/1127] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:26:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:00.183845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:00.184470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:00.190891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:00.191340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:00.192112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:00.192548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:00.255366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:00.264055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0f0bfb8e-a9de-4f3b-a4d1-7ae3b7287f32 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084336 May 10 20:27:00.264624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 558/1128] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:01.281299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:01.281907 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:01.288498 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:01.296475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:01.296475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:01.296475 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:01.355964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:01.363585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-055ad8fe-8202-4502-92aa-24ce7e0aaf92 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086400 May 10 20:27:01.364158 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 571/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:02.380292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:02.380882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:02.387185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:02.387635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:02.388405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:02.388839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:02.449337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:02.456925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7bc6b50-2e36-4f20-aeed-cdd0eb39b01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080531 May 10 20:27:02.457546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 559/1130] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:03.472549 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:03.473188 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:03.479674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:03.480122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:03.480891 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:03.481321 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:03.541203 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:03.548419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0264d3c2-05b6-4581-b430-d544f69b719d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079733 May 10 20:27:03.548981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 572/1131] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:04.564541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:04.565155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:04.571477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:04.571926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:04.572699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:04.573133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:04.634486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:04.641756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6557121a-c4b2-436c-8856-29d4da546777 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081065 May 10 20:27:04.642352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 560/1132] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:04 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:05.158275 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:27:05.158825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Tue May 10 20:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:27:05.658360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:05.658973 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:05.665894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:05.666356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:05.667116 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:05.667551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:05.726428 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:05.734332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6b9b7db1-ade1-4ab4-b725-93da06894f40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079782 May 10 20:27:05.734893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 573/1133] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:06.751063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:06.751680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:06.758131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:06.759085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:06.759948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:06.760388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:06.820417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:06.828623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b6c3ab31-b0e5-407c-b141-dce097bb2fa7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081612 May 10 20:27:06.829446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 561/1134] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:06 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:07.845989 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:07.846642 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:07.853120 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:07.853581 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:07.854393 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:07.854848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:07.927717 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:07.933088 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fd10b5eb-44c4-4124-b402-4e7a56598664 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.091027 May 10 20:27:07.933657 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 574/1135] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:07 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:08.951142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:08.951899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:08.958626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:08.959081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:08.959976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:08.960549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:09.021135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:09.029181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fae4d4b7-0d8e-44f0-85ba-e4f4623845cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082008 May 10 20:27:09.029750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 562/1136] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:10.045680 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:10.046400 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:10.052678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:10.053128 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:10.053898 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:10.054360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:10.114013 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:10.121834 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-865224a0-882f-4c43-b379-27b753c48765 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079979 May 10 20:27:10.122439 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 575/1137] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:11.138348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:11.138971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:11.145299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:11.145751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:11.146555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:11.146997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:11.209911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:11.219502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-840f965d-9360-4290-8e85-7baa61fa04a2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084959 May 10 20:27:11.220073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 563/1138] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:11 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:12.236145 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:12.236757 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:12.243591 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:12.244040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:12.244807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:12.245243 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:12.314784 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:12.322809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-42c4912d-779f-48da-8f80-d5f869345674 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.090589 May 10 20:27:12.323375 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 576/1139] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:13.340131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:13.340662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:13.346963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:13.347417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:13.348182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:13.348646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:13.407811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:13.415642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4b3a615b-e7d7-4fd5-9163-d8400e143c1f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079965 May 10 20:27:13.416227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 564/1140] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:13 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:14.432350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:14.432967 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:14.439281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:14.439735 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:14.440505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:14.440941 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:14.500480 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:14.507669 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b91fe27f-4a62-4d9c-97e7-3bbcb756a86c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079862 May 10 20:27:14.508249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 577/1141] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:15.523757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:15.524348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:15.530776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:15.531229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:15.532004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:15.532445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:15.592180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:15.599467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-12f4be2a-6fee-49d1-9748-78741307d176 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079679 May 10 20:27:15.600042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 565/1142] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:15 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:16.616353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:16.616831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:16.623165 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:16.623618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:16.624385 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:16.624822 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:16.689904 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:16.699089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-202dbccd-fea5-4bca-9912-5a3f05032ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086822 May 10 20:27:16.702441 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 578/1143] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:16 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:17.717932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:17.718599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:17.724921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:17.725529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:17.726443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:17.727501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:17.789988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:17.797288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5f94b10e-c121-4d68-bdbc-4ec9be890ab6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083249 May 10 20:27:17.797857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 566/1144] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:18.814064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:18.814683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:18.821080 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:18.821528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:18.822324 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:18.822757 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:18.882015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:18.889280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e21ca310-9c0d-4cac-9e26-c9d577f51ac8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079058 May 10 20:27:18.889836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 579/1145] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:18 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:19.906518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:19.907123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:19.913473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:19.913938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:19.914708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:19.915140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:19.976277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:19.983604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a6d18cf4-c8fd-426a-8a60-338af5da6793 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080909 May 10 20:27:19.984178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 567/1146] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:20.999783 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.000326 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:21.006658 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:21.007109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:21.007880 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:21.008819 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:21.069883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:21.077763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-74760415-0d5b-4dec-8391-5642b6a871ee tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081958 May 10 20:27:21.078360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 580/1147] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:22.095249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:22.095859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:22.102361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:22.102805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:22.103565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:22.103998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:22.164017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:22.171209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e842fe09-5eb5-4930-bbd0-da6dc2bfd27d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079819 May 10 20:27:22.171779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 568/1148] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:23.188162 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:23.188768 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:23.195143 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:23.196089 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:23.196849 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:23.197280 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:23.256198 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:23.264119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a15f5165-8bc8-4770-9412-405e8b09faec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079952 May 10 20:27:23.264689 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 581/1149] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:23 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:24.281141 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:24.282020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:24.288204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:24.288651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:24.289426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:24.289860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:24.349943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:24.357235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7098c489-9487-4361-b569-e65f58dac206 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080097 May 10 20:27:24.357802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 569/1150] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:24 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:25.374164 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:25.374776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:25.380725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:25.381172 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:25.381937 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:25.382410 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:25.445579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:25.453646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0f8ee872-2efc-4521-89c4-21688cadf01a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083496 May 10 20:27:25.454505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 582/1151] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:25 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:26.470641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:26.471284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:26.477242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:26.477693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:26.478568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:26.479004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:26.538379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:26.546187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd5278f8-550c-4c46-9827-73df936664e5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079427 May 10 20:27:26.546756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 570/1152] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:26 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:27.562878 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:27.563492 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:27.569807 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:27.570289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:27.571059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:27.571495 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:27.630856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:27.638050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0a20b3d7-fa5b-4e92-a5b3-c344bbb1a022 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079136 May 10 20:27:27.638631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 583/1153] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:27 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:28.654728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:28.655319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:28.661588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:28.662038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:28.662829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:28.663263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:28.726131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:28.733698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5482b87e-bd00-4451-abb6-aa9f56164d24 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082781 May 10 20:27:28.734309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 571/1154] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:28 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:29.750460 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:29.751039 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:29.757302 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:29.757756 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:29.758561 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:29.759003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:29.820579 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:29.828635 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-077ee4fd-64ce-4794-9598-c9992d409156 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082078 May 10 20:27:29.829463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 584/1155] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:29 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:30.846488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:30.847131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:30.854315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:30.854771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:30.855547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:30.855981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:30.916314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:30.923735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dc4fa49e-bf99-4861-892f-2c1d5d8976e9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081275 May 10 20:27:30.924317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 572/1156] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:30 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:31.940299 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:31.940921 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:31.947432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:31.947881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:31.948760 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:31.949081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:32.010962 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:32.018497 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c1e75ece-dcd3-40b0-88a6-3e7cc42bd51c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082135 May 10 20:27:32.019068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 585/1157] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:33.035124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:33.035792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:33.042437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:33.042904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:33.043747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:33.044215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:33.107276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:33.114734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dcd4d077-3faa-451c-a6ab-5587ce56b55d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083571 May 10 20:27:33.115307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 573/1158] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:34.131872 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:34.132484 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:34.139346 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:34.139789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:34.140555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:34.140986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:34.213130 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:34.220654 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-af2d9c3b-bbcb-42f7-a947-ba344ba9b9dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.092659 May 10 20:27:34.221599 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 586/1159] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:35.237699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:35.238355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:35.244788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:35.245241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:35.246016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:35.246477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:35.305383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:35.312697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-caa60cc6-4680-4e80-ac6a-57f83357d77c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078815 May 10 20:27:35.313268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 574/1160] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:36.328592 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:36.329461 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:36.335818 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:36.336267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:36.337122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:36.337558 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:36.399351 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:36.406513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-22f10bce-ad1d-43d8-a2ac-4aeeb0700eeb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081678 May 10 20:27:36.407016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 587/1161] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:37.423617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:37.424162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:37.430551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.431713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.432275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.432837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.495634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:37.502996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-458b15c2-61eb-41bd-9270-45f156276d5f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083300 May 10 20:27:37.503574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 575/1162] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:38.521028 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:38.521572 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:38.527824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:38.528267 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:38.529025 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:38.529456 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:38.588693 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:38.595986 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bc77c943-cabc-4866-82b7-4bbf338f55ec tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078837 May 10 20:27:38.596544 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 588/1163] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:38 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:39.612944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:39.613465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:39.620438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:39.620878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:39.621639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:39.622065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:39.680811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:39.687980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1ca43923-d0ec-4185-af74-fc135431ba1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078995 May 10 20:27:39.688547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 576/1164] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:40.704211 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:40.707127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:40.711585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.712042 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.713325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.713761 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.774236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:40.782263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6335d5c5-e5e2-4dd3-b8ed-3169c552e5f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082139 May 10 20:27:40.782831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 589/1165] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:41.798946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:41.799563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:41.805848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:41.806883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:41.807652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:41.808089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:41.866996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:41.874918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-24dbe7e6-686c-4973-9e8d-3b2b87410843 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079911 May 10 20:27:41.875491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 577/1166] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:42.891219 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:42.891830 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:42.898108 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:42.898553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:42.899310 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:42.899743 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:42.963820 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:42.971420 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-685b8826-9969-4db8-aded-c087db06eaba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084074 May 10 20:27:42.971991 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 590/1167] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:43.988275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:43.989007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:43.995397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.995845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.996615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.997045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:44.057474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.064691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab91ca03-bb46-45fe-872f-1a77bc1d7418 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080389 May 10 20:27:44.065254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 578/1168] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:45.082070 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:45.082710 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:45.089605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.090062 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.090862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.091300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.151851 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.159251 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c2077c1f-6da6-4b77-8edb-06d0337dfb65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081320 May 10 20:27:45.159824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 591/1169] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:46.176621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:46.177297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:46.183556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.184010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.184785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.185227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.257897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:46.266260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c277e02d-eac8-4e65-ac52-b0982f7856e1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.093503 May 10 20:27:46.266839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 579/1170] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:47.283809 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:47.284432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:47.291421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.291878 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.292653 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.293092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.353262 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.360804 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-073e9534-b285-481b-abea-ec8b115a3f50 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080883 May 10 20:27:47.361381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 592/1171] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:48.377462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:48.378115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:48.384448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.384898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:48.385664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.386119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:48.449567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:48.457458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec44b817-9cdd-483a-b584-372ee38ee940 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083800 May 10 20:27:48.459585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 580/1172] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:49.473976 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:49.474638 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:49.480953 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.481403 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.482208 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.482644 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.542553 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.549816 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2ad81b5b-beb4-4fd6-9e6d-4238ea3ed760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079709 May 10 20:27:49.550417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 593/1173] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:50.566322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:50.566974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:50.573388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.573842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.574648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.575085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.635274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:50.642457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cab9b230-840d-4e9a-a970-2c26e4726fb6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079935 May 10 20:27:50.643030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 581/1174] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:50 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:51.659068 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:51.659685 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:51.666001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:51.666524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:51.667300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:51.667739 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:51.732443 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.739856 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3b0e2934-fa00-4f35-a997-403388af4cd6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084621 May 10 20:27:51.740424 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 594/1175] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:52.756863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:52.757480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:52.764460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.764910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.765675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.766136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.825469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.833112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-263d072c-3bab-4faa-972e-da290405712b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080123 May 10 20:27:52.833683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 582/1176] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:53.850008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:53.850650 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:53.857493 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.857946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.858745 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.859180 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.920124 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:53.927670 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6c914253-5cdc-43c1-9bad-783ac83326eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081548 May 10 20:27:53.928246 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 595/1177] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:53 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:54.943677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:54.944325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:54.952660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.953096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:54.954164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.954605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:55.027646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:55.028622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a04c67e8-1077-42b1-a939-2cb9e1f06afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088878 May 10 20:27:55.029280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 583/1178] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:56.053528 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:56.054177 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:56.060715 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.061017 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.061805 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.062283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.122620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:56.129918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-62d9d550-e080-45ea-aa18-6d8de6684442 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088360 May 10 20:27:56.130510 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 596/1179] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:57.146123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:57.146833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:57.152735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:57.153186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:57.154051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:57.154537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:57.217885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:57.225354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ef4e4956-7f93-482e-9a47-b636e4107426 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083355 May 10 20:27:57.225933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 584/1180] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:58.241764 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:58.242421 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:58.248821 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.249273 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.250045 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.250516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.310199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.317551 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-40e00d5b-6906-4b95-aa3d-2a84f397536b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079794 May 10 20:27:58.318132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 597/1181] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:59.334938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:59.335558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:59.342419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.342878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.343653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.344094 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.403317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.410557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d8ae60b6-5324-47d1-887d-9d00a52e8c4c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079423 May 10 20:27:59.411126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 585/1182] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:27:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:00.428053 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:00.428705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:00.435264 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.435719 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.436496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.436940 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.499609 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:00.506927 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5e1dcef2-4766-457e-ae65-2d255975694a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082762 May 10 20:28:00.507505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 598/1183] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:01.524159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:01.524712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:01.531090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.531538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.532303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.532760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.592367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.599582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e12b5f91-20ff-4b83-902e-42d8fc232dc7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079422 May 10 20:28:01.600160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 586/1184] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:02.616862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:02.617414 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:02.623752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.624205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.624977 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.625417 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.684524 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.691814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3ea29368-e9da-4a59-bc1a-6c5b4419726e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078957 May 10 20:28:02.692463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 599/1185] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:03.709038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:03.709656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:03.716673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.717119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:03.718060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.718639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:03.780873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:03.788302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-380ce743-033f-4509-9ca3-08db7da9ebc1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083149 May 10 20:28:03.788874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 587/1186] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:04.805216 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:04.810479 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:04.812641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.813098 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.813866 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.814330 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.874445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.881794 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-67aa8eee-6d25-4697-9d92-5c5730ddbaf1 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080548 May 10 20:28:04.882432 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 600/1187] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:04 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:05.898841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:05.899963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:05.906269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.906715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.907477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.907907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.970312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.977631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ae8b1076-c602-4d52-8fe4-70861ba6e72b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082779 May 10 20:28:05.978227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 588/1188] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:06.994367 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:06.994998 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:07.001425 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.001817 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.002623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.003059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.064040 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:07.071789 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-39d0171d-25db-458a-a229-cbb22949b6f9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080910 May 10 20:28:07.072368 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 601/1189] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:06 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:08.087525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:08.088180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:08.094662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.095106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.095875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.096305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.155988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.163374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fd05bbc9-2661-48d7-b6b4-1c92fee1b983 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079729 May 10 20:28:08.163939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 589/1190] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:09.181295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:09.181916 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:09.188234 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.188692 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.189473 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.189916 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.256882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:09.264931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4d120252-4c33-49ff-ab69-4021afc1d3a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088116 May 10 20:28:09.265500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 602/1191] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:09 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:10.281706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:10.282355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:10.288726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.289169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.289937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.290405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.351424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:10.359045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f00e5e6d-37f2-4d13-a3a8-b9629af31b3e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081303 May 10 20:28:10.359615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 590/1192] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:11.375655 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:11.376315 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:11.382605 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.383059 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.383832 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.384269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.444244 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.451796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d32b2870-63d9-4808-88a8-799ca1cf441d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079978 May 10 20:28:11.452377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 603/1193] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:11 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:12.468857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:12.469478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:12.475983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.476427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.477219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.478175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.537342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.545137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6fd8db4-5b62-4727-a333-acb450bae4e2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080215 May 10 20:28:12.545714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 591/1194] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:13.562392 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:13.563014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:13.569463 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.570233 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.570711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.571725 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.637481 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.644890 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bfb73a79-7baf-475e-a704-a53225aa6caa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086442 May 10 20:28:13.645470 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 604/1195] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:13 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:14.660575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:14.661202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:14.668043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.668495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.669276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.669715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.732205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:14.739538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43330082-70a1-4147-be57-ab88a9052ee3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082808 May 10 20:28:14.740109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 592/1196] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:15.756992 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:15.757606 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:15.763969 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.764418 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.765201 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.765626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.825646 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:15.833205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9d5eb75c-a67c-4e80-befb-c8f16f7e0e72 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080081 May 10 20:28:15.833778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 605/1197] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:15 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:16.849810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:16.850463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:16.856902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:16.857359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:16.858158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:16.858601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:16.920066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.927400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cb0d1b35-0866-4976-a3b6-3a9e9821f2af tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081410 May 10 20:28:16.927994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 593/1198] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:16 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:17.944096 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:17.944716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:17.951698 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.952149 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.952915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.953608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.016290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.023580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a4ec658-f03f-4249-895a-f29fb4485443 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083401 May 10 20:28:18.024372 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 606/1199] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:19.045894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:19.047045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:19.055790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.057086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.057970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.058505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.120466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:19.127729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-64f82871-6664-4298-aac0-7a2e3957665f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086839 May 10 20:28:19.128285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 594/1200] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:20.144156 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:20.144765 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:20.151069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.151516 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:20.152281 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.152716 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:20.215939 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:20.223154 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-730b391a-4306-4275-93ed-5d193d833596 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082839 May 10 20:28:20.223719 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 607/1201] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:21.239639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:21.240904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:21.247534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:21.247992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:21.248773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:21.249222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:21.308895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.316282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc7c22e1-cf70-4d83-8514-66765ffc4ab0 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080472 May 10 20:28:21.316847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 595/1202] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:21 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:22.333611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:22.334332 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:22.341248 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.341703 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.342503 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.342946 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.401016 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.408815 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f0ba432-3b75-40ba-968d-aec929b408ce tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079074 May 10 20:28:22.409381 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 608/1203] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:23.426204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.426823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.433662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.434126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.434902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.435339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.498802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.506029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-be9477e4-82ce-456b-8298-2233113192a5 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083852 May 10 20:28:23.506623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 596/1204] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:23 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:24.522824 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:24.523445 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:24.529771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.530252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.531022 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.531462 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.593092 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:24.601620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-93f27a37-0408-4a90-be02-a3cee7064133 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082614 May 10 20:28:24.602231 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 609/1205] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:24 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:25.619296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:25.619952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:25.626335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.626789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.627586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.628021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.688002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:25.695431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-597815dc-a31c-418e-b6c9-012b0fbad0e3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080262 May 10 20:28:25.696004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 597/1206] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:25 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:26.712238 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:26.712862 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:26.719554 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.720008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.720782 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.721228 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.782893 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.790202 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-79d841fe-c024-46b4-9f44-1002ffda5fed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081813 May 10 20:28:26.790778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 610/1207] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:26 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:27.806978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:27.807535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:27.813860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.814345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.815114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.815548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.875476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.882820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-64187575-404a-44e0-8e77-fa5799562039 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079802 May 10 20:28:27.883388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 598/1208] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:27 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:28.899674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.900292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.907229 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.907683 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.908457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.908903 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.982236 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.989755 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e396ba1f-fd7e-436b-bc09-3e38842a3f9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.093997 May 10 20:28:28.990360 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 611/1209] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:30.005930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:30.006570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:30.013478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:30.013926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.014781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:30.015218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.073529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.081722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-91aa5fca-16f8-44ef-800b-f90c28d3e809 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079644 May 10 20:28:30.082323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 599/1210] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:30 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:31.098517 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:31.099141 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:31.105571 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.106033 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.106835 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.107278 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.166620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:31.173931 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f91bb28-4767-45a1-baaf-028d8f07060f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079308 May 10 20:28:31.174535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 612/1211] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:32.190986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:32.191603 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:32.197983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.198470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.199247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.200321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.264958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.272176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfc4d863-5140-490f-849b-5295ce35e290 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085069 May 10 20:28:32.272747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 600/1212] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:32 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:33.288889 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:33.289534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:33.296364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.296842 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.297615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.298052 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.357652 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.364933 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-92225bff-b634-453a-a1ad-05ac0e59b001 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079981 May 10 20:28:33.365507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 613/1213] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:34.382651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:34.383269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:34.390240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.390692 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.391462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.391903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.450816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:34.458385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ef3ae1b6-4223-41a0-b679-f219a55c3016 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079570 May 10 20:28:34.458961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 601/1214] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:35.474981 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:35.475600 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:35.482496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:35.482947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:35.483775 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:35.484199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:35.548256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:35.555626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-651719df-7087-48b7-b6bd-23ad1f2379b9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084499 May 10 20:28:35.556200 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 614/1215] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:36.572713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:36.573330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:36.579984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.580443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.581215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.581655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.641413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:36.649858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-62daaac1-0d96-4ee1-acfa-6a4a4497e231 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081041 May 10 20:28:36.650456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 602/1216] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:37.665641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:37.666300 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:37.673082 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.673533 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.674336 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.674774 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.735012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:37.742291 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4c12b0c5-81b5-4207-a374-24615fc34808 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080417 May 10 20:28:37.742848 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 615/1217] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:38.758983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:38.759702 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:38.767871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.768324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.769151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.769592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.831789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:38.839186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b8b95c9-7443-456a-a37a-e9af74c3dfa3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084080 May 10 20:28:38.839764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 603/1218] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:38 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:39.855513 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:39.856741 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:39.863050 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:39.863508 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.864282 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:39.864728 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.924286 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:39.931610 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e419014-f59d-48bf-8eaa-bd1fceb80302 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079894 May 10 20:28:39.932183 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 616/1219] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:40.948209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:40.948851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:40.955905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.956349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.957106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.957538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:41.021149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:41.029407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-28ffe5b9-2a55-469b-a531-363edfcd9fd9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085001 May 10 20:28:41.029967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 604/1220] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:42.046500 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:42.047122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:42.053723 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.054220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.055008 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.055454 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.117909 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:42.125343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0af27f3e-d124-4a72-8a07-71cceec325fc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083297 May 10 20:28:42.125786 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 617/1221] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:43.141351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:43.141979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:43.151506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:43.153787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:43.154990 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:43.155432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:43.217618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:43.224939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9262a05-4462-4058-a206-6424920b9b62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.088320 May 10 20:28:43.225510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 605/1222] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:44.240603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:44.241257 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:44.248354 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:44.248802 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:44.249580 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:44.250012 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:44.321615 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:44.329990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f087aa7-16c7-48f6-9d8f-ff2f0b65ca96 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.093215 May 10 20:28:44.330595 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 618/1223] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:45.346978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:45.347589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:45.353748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:45.354231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:45.354991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:45.355504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:45.415400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:45.422729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1e91e5f7-64d0-4ff9-96ed-8dc7d2df870a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079577 May 10 20:28:45.423302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 606/1224] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:46.438388 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:46.439005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:46.445293 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:46.445748 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:46.446585 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:46.447024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:46.507186 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:46.514457 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eb8521ff-9d48-40c2-a30f-ad2db0f14642 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079942 May 10 20:28:46.515021 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 619/1225] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:47.531277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:47.531891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:47.538212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:47.538662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:47.539433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:47.539874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:47.601229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:47.609012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0c176fe8-899b-4ac7-b60c-3b4ec9c3b969 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081614 May 10 20:28:47.609582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 607/1226] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:48.625959 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:48.626624 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:48.632932 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:48.633379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:48.634179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:48.634617 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:48.694220 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:48.702144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-87d61cfc-45b6-49ad-9a73-0f1d749651dc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080025 May 10 20:28:48.702975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 620/1227] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:49.720317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:49.720923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:49.727213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:49.727654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:49.728411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:49.728839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:49.788285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:49.795646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30ff2673-8d4f-4d15-9445-589b5e932afc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079847 May 10 20:28:49.796206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 608/1228] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:50.812379 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:50.813003 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:50.819843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:50.820295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:50.821079 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:50.821515 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:50.883090 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:50.890582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-60aa53a8-b2cd-4113-a251-1fb58be1968e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082312 May 10 20:28:50.891166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 621/1229] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:50 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:51.908135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:51.908701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:51.915104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:51.915560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:51.916330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:51.916768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:51.980517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:51.987924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c5ba7169-ace3-44fc-ba20-30ec37b76ce4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084474 May 10 20:28:51.988500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 609/1230] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:53.005005 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:53.005631 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:53.012051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:53.012507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:53.013911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:53.014374 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:53.078945 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:53.086353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8c676776-d0bc-433e-852c-28cc9a910fdf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085222 May 10 20:28:53.086924 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 622/1231] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:54.103160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:54.103767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:54.110743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:54.111189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:54.111948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:54.112378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:54.171954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:54.179436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8d765111-f48b-4b62-9df0-e4b32ed224cb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080172 May 10 20:28:54.180007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 610/1232] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:55.196712 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:55.197337 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:55.203650 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:55.204101 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:55.204873 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:55.205340 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:55.268292 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:55.275587 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c04b8709-abd0-497f-b7a6-02b4093299cc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082776 May 10 20:28:55.276144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 623/1233] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:56.292883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:56.293584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:56.299772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:56.300216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:56.300977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:56.301413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:56.365102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:56.372968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-04757410-b65c-4e99-97d9-1e5035963d65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084138 May 10 20:28:56.373537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 611/1234] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:57.390011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:57.390648 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:57.397032 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.397476 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.398269 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.398705 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.459011 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:57.467126 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-89fd1001-86eb-4d10-84da-4e3a49bfaa06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081500 May 10 20:28:57.467720 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 624/1235] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:58.483454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:58.484139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:58.491391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.491834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.492598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.493031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.553298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:58.561695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5753b92a-da42-44c8-a8d6-e01bbf5937a6 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082140 May 10 20:28:58.562293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 612/1236] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:59.581364 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:59.581978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:59.588359 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.588808 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.589574 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.590010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.649604 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:59.657010 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1a28bda2-8f63-445f-93a0-6c4a323d9aed tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079706 May 10 20:28:59.657584 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 625/1237] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:28:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:00.674408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:00.675024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:00.681572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.681963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.682764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.683205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.748044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:00.755397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4e3f8b16-64ca-410a-b836-308ceb56dca2 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084934 May 10 20:29:00.755972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 613/1238] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:00 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:01.772814 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:01.773426 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:01.780356 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:01.780796 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:01.781555 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:01.781988 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:01.845223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:01.852488 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-77fb2489-ee61-4598-a585-9daadfc6c2ba tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083832 May 10 20:29:01.853057 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 626/1239] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:02.868893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:02.869516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:02.875979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:02.880554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:02.880554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:02.880554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:02.939348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:02.946671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f093c674-b0b4-48ee-9553-9939468ee55a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081771 May 10 20:29:02.947242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 614/1240] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:02 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:03.963466 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:03.964104 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:03.970586 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.971034 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:03.971820 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.972252 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:04.032030 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:04.039538 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e359abe3-b0c1-461c-848f-07401049d542 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079889 May 10 20:29:04.040119 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 627/1241] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:03 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:05.055828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:05.056375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:05.063445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.063886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.064681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.065118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.131818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:05.141423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8302063c-b6f7-4c5a-88c5-fff1b795ad62 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.089449 May 10 20:29:05.142008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 615/1242] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:05 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:06.158700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:06.159311 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:06.165641 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.166107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.166882 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.167317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.231126 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:06.239094 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d9db93d-c911-4bf4-ac2a-37f5b1a5693c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084172 May 10 20:29:06.239731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 628/1243] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:06 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:07.255519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:07.256239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:07.262846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.263287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.264058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.264494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.328395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:07.335755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab8d8978-4b20-4177-a74a-58d1421bba21 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084079 May 10 20:29:07.336325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 616/1244] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:07 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:08.352334 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:08.352971 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:08.359338 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.359781 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:08.360536 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.360964 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:08.420833 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:08.429179 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-297e7c79-3b1e-4644-98c3-2de7a4d24af4 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080679 May 10 20:29:08.429843 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 629/1245] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:08 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:09.446941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:09.447553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:09.454155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.454603 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.455363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.455797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.517816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:09.525284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-20756c41-bbeb-4721-ab72-4d9255332200 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082286 May 10 20:29:09.525855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 617/1246] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:09 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:10.542699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:10.543312 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:10.549532 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.549978 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.550771 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.551295 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.613662 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:10.620936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f2e18690-36d6-4d99-b1e8-555fb9426cbb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082104 May 10 20:29:10.621496 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 630/1247] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:10 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:11.638366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:11.638972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:11.645324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.645771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.646626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.647060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.707323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:11.714624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c4127879-286c-4d14-8e7d-08b5d3438bf7 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080663 May 10 20:29:11.715183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 618/1248] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:11 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:12.732429 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:12.733028 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:12.739384 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.739846 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.740620 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.741064 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.800990 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:12.808209 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-430d655e-431c-4f02-80b5-6042809340f3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080389 May 10 20:29:12.808778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 631/1249] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:12 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:13.825056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:13.825577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:13.832099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.832561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.835116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.835558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.894954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:13.902220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b5b863e2-6f26-4225-bb0d-82adfc70b456 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081171 May 10 20:29:13.902789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 619/1250] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:13 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:14.919079 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:14.919634 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:14.925883 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.926378 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.927150 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.927645 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.989836 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:14.997290 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-400f8523-dbf3-48e1-a2c0-349044355382 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082822 May 10 20:29:14.997852 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 632/1251] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:14 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:16.013892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:16.014537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:16.021163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.021609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.022405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.022843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.087938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:16.095250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dacaa791-2fa2-47b8-85ff-f9ca0cd6bad3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085344 May 10 20:29:16.095813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 620/1252] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:16 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:17.111961 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:17.112602 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:17.118924 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.119371 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.120132 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.120562 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.180176 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:17.187911 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d17a3722-90ea-431e-bcea-7e1af8d21241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079820 May 10 20:29:17.188509 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 633/1253] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:17 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:18.205189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:18.205832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:18.212152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.212601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.213365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.213799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.275968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:18.283959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dcf4d152-9664-4b5f-889e-5ca4a39fcbbf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082872 May 10 20:29:18.284535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 621/1254] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:18 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:19.300534 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:19.301254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:19.307740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.308191 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.308972 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.309407 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.374210 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:19.381519 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dfc337f1-c90b-4714-8008-078e97c9b23e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084879 May 10 20:29:19.382109 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 634/1255] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:19 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:20.399576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:20.400188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:20.406613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.407065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:20.407833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.408266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:20.473219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:20.486395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fdf950b2-f83f-407e-8735-c3875d124562 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.090623 May 10 20:29:20.487204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 622/1256] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:20 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:21.504607 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:21.505222 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:21.511702 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:21.512740 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.513515 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:21.513952 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.583396 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:21.590701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fbc9c99f-8c70-43b7-9729-ab82e170dadc tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.090126 May 10 20:29:21.591294 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 635/1257] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:21 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:22.608153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:22.608764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:22.615191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.615632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.616390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.616817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.676151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:22.683387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b497403a-ea3b-43cf-b95d-461f79cf923e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079693 May 10 20:29:22.683892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 623/1258] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:22 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:23.699778 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:23.700419 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:23.707001 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.707452 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.708215 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.708653 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.768611 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:23.776166 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3e06e5e1-f496-47fc-a7d0-2a5aedb27b4a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080297 May 10 20:29:23.776730 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 636/1259] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:23 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:24.794252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:24.794876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:24.801334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.801793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.802608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.803052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.864471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:24.872403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3dd5a388-a3f2-437f-b717-8475728ede2f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082676 May 10 20:29:24.872980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 624/1260] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:24 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:25.889709 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:25.890353 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:25.896317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.896788 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.897541 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.897975 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.958570 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:25.966448 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-89107244-12d2-4124-8955-09a8e1d4c241 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080689 May 10 20:29:25.967014 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 637/1261] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:25 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:26.983735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:26.984393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:26.990408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.990860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.991631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.992068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.055342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:27.062721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-18165a01-7517-4499-b5b3-5a83b9bb546a tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083546 May 10 20:29:27.063298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 625/1262] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:26 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:28.079623 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:28.080249 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:28.086661 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.087114 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:28.087884 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.088325 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:28.152182 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:28.159666 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-33739e75-9ef8-49e8-ac3a-1d326cddca1d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084207 May 10 20:29:28.160250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 638/1263] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:28 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:29.176036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:29.176735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:29.183055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.183501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.184807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.185247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.250210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:29.257639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd6b4dd0-d232-4919-992c-9ce02e7879d9 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.085336 May 10 20:29:29.258239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 626/1264] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:29 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:30.275199 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:30.275731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:30.282900 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:30.283350 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:30.284122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:30.284559 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:30.346876 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:30.354826 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c237ee29-566e-4aa5-84a7-d064fd2ebdb8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083434 May 10 20:29:30.355425 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 639/1265] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:30 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:31.372184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:31.372830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:31.379174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.379628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.380400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.380840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.443903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:31.451404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-34ea41d5-076a-4f74-ae13-8161a681fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082929 May 10 20:29:31.452205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 627/1266] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:31 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:32.468339 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:32.468957 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:32.475256 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.475699 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.476459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.476894 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.536081 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:32.543241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-96010771-54f7-4788-a53e-c624713ebd65 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078760 May 10 20:29:32.544319 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 640/1267] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:32 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:33.559523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:33.560136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:33.566562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.567013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.567773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.568210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.627844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:33.635198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-559c36b0-e351-46e2-b250-149e6ff26b40 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079527 May 10 20:29:33.635771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 628/1268] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:33 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:34.650922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:34.651438 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:34.657766 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.658250 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.659024 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.659459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.722343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:34.729701 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d70828b5-e6c4-4030-b3b3-1a56de6df106 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082733 May 10 20:29:34.730296 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 641/1269] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:34 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:35.746384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:35.747658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:35.753964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.754449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.755223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.755665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.818127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:35.825495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-07e4333e-0e17-4856-bb68-98b8dc3fe7ef tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.083012 May 10 20:29:35.826075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 629/1270] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:35 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:36.842429 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:36.843069 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:36.849365 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.849812 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.850616 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.851052 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.912377 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:36.920115 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e05812df-2716-449a-9496-273d7f330409 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081517 May 10 20:29:36.920681 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 642/1271] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:36 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:37.936987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:37.937550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:37.944072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.944529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:37.945303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.945744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.007765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.015801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b4a6b243-2347-45c6-a802-da5129c8fb9e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082836 May 10 20:29:38.016403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 630/1272] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:37 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:39.033507 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:39.034038 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:39.040668 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.041122 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.041983 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.042451 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.102831 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:39.110792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cef5a50f-afd6-403c-b502-4bdde735d979 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081425 May 10 20:29:39.111355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 643/1273] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:39 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:40.127411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:40.127957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:40.134352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.134808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.135580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.136020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.195384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.203640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4b49c20a-6da9-479a-8a87-076258ade4eb tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080087 May 10 20:29:40.204223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 631/1274] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:40 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:41.220612 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:41.221263 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:41.227603 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.228051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.228816 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.229254 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.289307 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.297107 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1806a8e1-0bca-45fa-be7a-12896e14c961 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080385 May 10 20:29:41.297678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 644/1275] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:41 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:42.313799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:42.314448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:42.321478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.321931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.322740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.323178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.383241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:42.390535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d803c07a-5875-49e3-8b04-df453c913d94 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080700 May 10 20:29:42.391118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 632/1276] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:42 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:43.407317 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:43.407915 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:43.414283 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.414735 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.415499 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.415936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.475801 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.483051 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c241bd32-c77d-4f04-93ee-0968e5c0b760 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079642 May 10 20:29:43.483618 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 645/1277] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:43 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:44.500362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:44.501009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:44.507343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.507789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.508551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.508982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.570555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.578106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a57b1076-348c-4c44-9be1-a904af8775aa tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.082248 May 10 20:29:44.578695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 633/1278] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:44 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:45.594987 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:45.595633 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.601922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.602408 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.603187 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.603626 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.668066 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.675773 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-feafed23-ac4e-439d-992c-2c5d36c2d35f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.084609 May 10 20:29:45.676289 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 646/1279] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:45 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:46.692788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:46.693310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:46.700808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.701781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.702599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.703034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.772878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.781843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c049ce54-45a0-42cd-8f5b-e1a3e3f845dd tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.092945 May 10 20:29:46.782460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 634/1280] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:46 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:47.798505 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:47.799127 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:47.805491 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.805947 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.806763 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.807205 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.867223 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:47.875258 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-060a8749-e3f4-4b52-9fd6-364986aed933 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080608 May 10 20:29:47.875835 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 647/1281] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:47 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:48.892514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:48.893135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:48.899516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.899970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.900739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.901180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.962263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.970620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9e91d2f-bebf-4e45-b121-9e5dc21b91d8 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081778 May 10 20:29:48.971341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 635/1282] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:48 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:49.987706 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:49.988333 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:49.994711 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.995156 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.995922 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.996954 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.057776 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.065043 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9dc32aab-663c-4222-9e90-4d764cc9d24f tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081277 May 10 20:29:50.065608 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 648/1283] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:49 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:51.081693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:51.082475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:51.088824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.089275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:51.090054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.090526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:51.151448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:51.158968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c85683f-3b68-4d3d-a7b5-a1ac4695de60 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081136 May 10 20:29:51.159624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 636/1284] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:51 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:52.176734 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:52.177343 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:52.183700 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:52.184151 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:52.184918 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:52.185355 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:52.247123 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.254790 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce564265-1737-4997-b928-df0ef47c7b7c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081940 May 10 20:29:52.255363 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 649/1285] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:52 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:53.272199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:53.272813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:53.280452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.280910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.281694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.282158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.356541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:53.364671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68734fec-4c59-4706-b9be-f5ded67ba91e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.096488 May 10 20:29:53.365244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 637/1286] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:53 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:54.499881 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:54.500494 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:54.506383 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.506825 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.507582 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.508015 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.569913 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:54.577522 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-75a01ddd-67c9-4c3d-812c-f534f334e38b tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.200740 May 10 20:29:54.578100 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 650/1287] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:54 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:55.594547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:55.595191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:55.601553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:55.601998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.602806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:55.603245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.669045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.676339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ded11846-8164-4d21-bcb7-c8726e1b78a3 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.086455 May 10 20:29:55.676923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 638/1288] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:55 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:56.692930 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:56.693567 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:56.699731 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.700175 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.700936 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.701639 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.760535 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.767792 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6dc30c50-d4d7-47cd-a4c5-570a31b3c696 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.078732 May 10 20:29:56.768373 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 651/1289] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:56 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:57.784048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:57.784803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:57.791199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.791653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.792421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.792923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.853692 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:57.861613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4dfdd053-48ef-47cd-8345-5f91764f9c6c tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081498 May 10 20:29:57.862210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 639/1290] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:57 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:58.877241 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:58.877958 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:58.884232 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.884678 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.885459 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.885892 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.955279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.955279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-554bc401-052c-4fca-bd9c-af469c306e3d tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.080085 May 10 20:29:58.955279 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 652/1291] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:58 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:59.970541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:59.971091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:59.977607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.978057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.978849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.979284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.038515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.046390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-79871cc0-e3a8-4aa3-a92f-cec0327d617e tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.079714 May 10 20:30:00.046961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 640/1292] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:29:59 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:01.063752 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-697daa8d-caff-4451-9722-cd7814ce54cf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:01.064303 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-697daa8d-caff-4451-9722-cd7814ce54cf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:01.070847 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-697daa8d-caff-4451-9722-cd7814ce54cf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.071306 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-697daa8d-caff-4451-9722-cd7814ce54cf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.072144 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-697daa8d-caff-4451-9722-cd7814ce54cf tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.080511 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: Traceback (most recent call last): May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: timer() May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: cb(*args, **kw) May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: waiter.switch() May 10 20:30:01.080674 dv-cinder-828805-2-iscsi devstack@n-api.service[117755]: greenlet.error: cannot switch to a different thread May 10 20:30:10.982209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:30:10.982736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:30:16.023114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:30:16.023783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:30:21.375618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:30:21.376255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:30:58.360579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:58.361218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:58.367374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.367823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.368601 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.369038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.452174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lazy-loading 'services' on Instance uuid 9bb90d6b-7083-4118-94fa-736fbc886744 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:30:58.647930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e653eb66-de47-4d1a-8423-3599e4d75810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744/os-volume_attachments/eb47fc65-6345-4bbc-a1ef-e35f695fa451" status: 202 len: 0 microversion: 2.1 time: 0.291129 May 10 20:30:58.648554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 641/1293] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 20:30:58 2022] DELETE /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744/os-volume_attachments/eb47fc65-6345-4bbc-a1ef-e35f695fa451 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:31:01.118469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:01.119125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] [instance: 2ddf4267-70b6-417f-b6de-6873fb9117a4] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:01.125321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.125839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.126643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.127084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.187996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f79341ab4462b3d51352ccb9de2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9724c9a575141d48bbfbde685774622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:01.195356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9670bc4d-89a2-49f7-ae2a-c07c16e41a06 tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4" status: 200 len: 1220 microversion: 2.1 time: 0.081779 May 10 20:31:01.195922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 642/1294] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:31:01 2022] GET /compute/v2.1/servers/2ddf4267-70b6-417f-b6de-6873fb9117a4 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:01.423401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba9db72e-11a7-4d98-9607-261c0ffa5abe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] Calling method '.version_select at 0x7f6029146670>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:01.505686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba9db72e-11a7-4d98-9607-261c0ffa5abe tempest-TestShelveInstance-1911592961 tempest-TestShelveInstance-1911592961-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2092652250" status: 202 len: 0 microversion: 2.1 time: 0.086043 May 10 20:31:01.506335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 643/1295] 10.222.0.65 () {58 vars in 1253 bytes} [Tue May 10 20:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2092652250 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:32:59.553974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:59.553974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:59.561668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.561668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.561971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.562443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.592855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:32:59.890442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a17974d-4dc8-4083-a5da-78e0986da1cc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 204 len: 0 microversion: 2.1 time: 0.342742 May 10 20:32:59.893658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 644/1296] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:32:59 2022] DELETE /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:32:59.899416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:59.900153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:59.913136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.913136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.913136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.913136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:00.154645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:00.162231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7e7c41e-1012-489c-bbd5-2565769ad983 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1679 microversion: 2.1 time: 0.266762 May 10 20:33:00.162853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 645/1297] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:32:59 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:01.179407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:01.182656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:01.186360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.186820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.187628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.188068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.268239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:01.279190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4169c9e9-32e6-4839-a5f7-58001caf1345 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 200 len: 1611 microversion: 2.1 time: 0.103632 May 10 20:33:01.280100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 646/1298] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:01 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 1611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:01.543832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-5fbf9243-a920-440d-809c-905fda25c69b req-2e26a564-49ff-4a19-ada8-2c0579248a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c370a2b-a8cd-4cbf-ba4c-48b870291ba3", "name": "network-vif-deleted", "tag": "0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:01.554228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5fbf9243-a920-440d-809c-905fda25c69b req-2e26a564-49ff-4a19-ada8-2c0579248a2d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.554678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5fbf9243-a920-440d-809c-905fda25c69b req-2e26a564-49ff-4a19-ada8-2c0579248a2d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.569329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-5fbf9243-a920-440d-809c-905fda25c69b req-2e26a564-49ff-4a19-ada8-2c0579248a2d service nova] Creating event network-vif-deleted:0cbfb90d-9c7d-43b9-aea4-9e07ec8ac441 for instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 on hv-cinder-82880 May 10 20:33:01.574489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-5fbf9243-a920-440d-809c-905fda25c69b req-2e26a564-49ff-4a19-ada8-2c0579248a2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247042 May 10 20:33:01.575870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 647/1299] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:02.299064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:02.299064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:02.305076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.305501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.306306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.306741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.320533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 HTTP/1.1 May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:33:02.322480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:33:02.324268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '4c370a2b-a8cd-4cbf-ba4c-48b870291ba3'} May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:02.325718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:33:02.329280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:33:02.331076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:02.331076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88f407db-d955-4403-acff-9a4ee73a11f7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 404 len: 111 microversion: 2.1 time: 0.031021 May 10 20:33:02.331076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 648/1300] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:02 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:33:02.332983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af004f25-988e-47ce-9966-3efe2894cf36 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '.version_select at 0x7f6028dded30>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:02.400463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af004f25-988e-47ce-9966-3efe2894cf36 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946057570" status: 202 len: 0 microversion: 2.1 time: 0.071171 May 10 20:33:02.401050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 649/1301] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 10 20:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946057570 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:33:03.166354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5c5507a9-58fe-4d41-a003-d9adf9a19566 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: .version_select at 0x7f6028efdca0>, body: {"keypair": {"name": "tempest-keypair-1499365591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOKcO1wIo6LISS81pFa8y/eSPQecJDnL9Y1t6c+F+BvX8Z4cAmpCDgb93t67I9oNNsZT4NON1I6GWpdC1p0XjOwVuw/l56H+p4fML3CXnb1IYx2CblRvxjTSp6Fl8MGOA=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:03.180569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-5c5507a9-58fe-4d41-a003-d9adf9a19566 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:33:03.185206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-5c5507a9-58fe-4d41-a003-d9adf9a19566 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:33:03.263800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5c5507a9-58fe-4d41-a003-d9adf9a19566 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101554 May 10 20:33:03.264401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 650/1302] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:33:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:05.408651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1210643330", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97616d50-d128-4d48-95c9-0ecc4a239629"}], "security_groups": [{"name": "tempest-securitygroup--1879118450"}], "key_name": "tempest-keypair-1499365591", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:05.507070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] validate_networks() for [('97616d50-d128-4d48-95c9-0ecc4a239629', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:33:05.961135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:33:05.961569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:33:05.962049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:33:05.962504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:33:05.962921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:33:05.972277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.972724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.973529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.973964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.990532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:33:05.994419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:33:06.005052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:33:06.007315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:33:06.131618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b51e3832-13ad-4c4d-af8b-cb1be74c6cbc tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727620 May 10 20:33:06.132191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 651/1303] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:33:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 20:33:06.142428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-543b76d9-10a2-40f8-854d-c42d9edd1c9a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:06.143954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-543b76d9-10a2-40f8-854d-c42d9edd1c9a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:06.195479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-543b76d9-10a2-40f8-854d-c42d9edd1c9a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:06.203237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-543b76d9-10a2-40f8-854d-c42d9edd1c9a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1242 microversion: 2.1 time: 0.064535 May 10 20:33:06.203814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 652/1304] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:06 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:07.222375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:07.223092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:07.229938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.230411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.231245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.231695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.308288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:07.317560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b6413058-74e8-4536-9ac9-06147486be62 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1246 microversion: 2.1 time: 0.101157 May 10 20:33:07.318176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 653/1305] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:07 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:08.335873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:08.336362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:08.342912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.343362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.344139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.344577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.431846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:08.439058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2004ab84-1bc2-479e-9d60-1217c0af1ba4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1300 microversion: 2.1 time: 0.107451 May 10 20:33:08.439836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 654/1306] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:08 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:09.458606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:09.458606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:09.463808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.464257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.465040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.465477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.649690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:09.657062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-40462ca1-2305-4fa2-9321-a36b604ee3fd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.204277 May 10 20:33:09.657573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 655/1307] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:09 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:09.774605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-3228e875-c5e3-4d33-8b46-72e763101e9d req-7e830a7f-9e17-4f32-ac01-63b891a6b1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc41ee43-26c2-4b80-b44d-1efb5a10b299", "tag": "763e6174-5661-49a0-b0bb-40d39fde3357"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:09.783765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3228e875-c5e3-4d33-8b46-72e763101e9d req-7e830a7f-9e17-4f32-ac01-63b891a6b1b3 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.784233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3228e875-c5e3-4d33-8b46-72e763101e9d req-7e830a7f-9e17-4f32-ac01-63b891a6b1b3 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.796470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-3228e875-c5e3-4d33-8b46-72e763101e9d req-7e830a7f-9e17-4f32-ac01-63b891a6b1b3 service nova] Creating event network-changed:763e6174-5661-49a0-b0bb-40d39fde3357 for instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 on hv-cinder-82880 May 10 20:33:09.801519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-3228e875-c5e3-4d33-8b46-72e763101e9d req-7e830a7f-9e17-4f32-ac01-63b891a6b1b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036528 May 10 20:33:09.802049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 656/1308] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:10.675399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:10.676043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:10.682194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:10.682646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:10.683415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:10.683856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:10.814376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:10.823176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b55169d8-b3d9-46cf-9aa1-a30dc56f4133 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.152538 May 10 20:33:10.823787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 657/1309] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:10 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:11.840079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:11.840724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:11.854352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:11.854807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:11.855582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:11.856024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:11.991680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:11.998988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e65f12c-2081-47c4-9e8b-8234f01e4198 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.162907 May 10 20:33:11.999556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 658/1310] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:11 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:13.015455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:13.016108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:13.022595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.023056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.023830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.024271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.152320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:13.160007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d731ffd1-45c0-4ab7-b753-e552e960a00a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.148470 May 10 20:33:13.160588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 659/1311] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:13 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:14.176572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:14.177186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:14.183551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:14.184000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:14.184886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:14.185523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:14.331840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:14.349273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a6d2e83-031f-4fa0-b1cd-864bce91e532 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.176475 May 10 20:33:14.352260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 660/1312] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:14 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:15.368276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:15.369011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:15.375230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:15.375677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:15.376446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:15.376882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:15.500710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:15.507928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-27fa306c-4801-4d4b-b099-1dfc4b2244a1 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.143501 May 10 20:33:15.508506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 661/1313] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:15 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:16.091100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-dab1f7ae-67fa-4c04-b77d-88062fff8a7a req-0c39e490-55eb-4c82-9584-993fdc8adbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41ee43-26c2-4b80-b44d-1efb5a10b299", "name": "network-vif-plugged", "status": "completed", "tag": "763e6174-5661-49a0-b0bb-40d39fde3357"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:16.099081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dab1f7ae-67fa-4c04-b77d-88062fff8a7a req-0c39e490-55eb-4c82-9584-993fdc8adbf7 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:16.099526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dab1f7ae-67fa-4c04-b77d-88062fff8a7a req-0c39e490-55eb-4c82-9584-993fdc8adbf7 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:16.110490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-dab1f7ae-67fa-4c04-b77d-88062fff8a7a req-0c39e490-55eb-4c82-9584-993fdc8adbf7 service nova] Creating event network-vif-plugged:763e6174-5661-49a0-b0bb-40d39fde3357 for instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 on hv-cinder-82880 May 10 20:33:16.115464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-dab1f7ae-67fa-4c04-b77d-88062fff8a7a req-0c39e490-55eb-4c82-9584-993fdc8adbf7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085974 May 10 20:33:16.116059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 662/1314] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:16.525636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:16.526374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:16.533090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:16.533544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:16.534361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:16.534804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:16.663854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:16.671080 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fa49c472-17e8-4db8-8cfb-0f7aded0348a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1368 microversion: 2.1 time: 0.150114 May 10 20:33:16.671649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 663/1315] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:16 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:17.687690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:17.688377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:17.694765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:17.695213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:17.695981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:17.696677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:17.828422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:17.836712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ad1efa4-6f50-4e2d-9351-dabe13b2181a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1557 microversion: 2.1 time: 0.152886 May 10 20:33:17.837379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 664/1316] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:33:17 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:17.853144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:17.853627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:17.859397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:17.859837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:17.860596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:17.861020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:17.935052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6fc06d7d-cf7f-4c90-88f2-2e59f4b24bb9 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085603 May 10 20:33:17.935654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 665/1317] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:33:17 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:19.197732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-801a6c13-4027-4fd6-8c94-3b0418acfd86 req-3f182edb-543c-4ddf-ba19-123070ee5685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc41ee43-26c2-4b80-b44d-1efb5a10b299", "tag": "763e6174-5661-49a0-b0bb-40d39fde3357"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:19.206307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-801a6c13-4027-4fd6-8c94-3b0418acfd86 req-3f182edb-543c-4ddf-ba19-123070ee5685 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:19.206757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-801a6c13-4027-4fd6-8c94-3b0418acfd86 req-3f182edb-543c-4ddf-ba19-123070ee5685 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:19.218919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-801a6c13-4027-4fd6-8c94-3b0418acfd86 req-3f182edb-543c-4ddf-ba19-123070ee5685 service nova] Creating event network-changed:763e6174-5661-49a0-b0bb-40d39fde3357 for instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 on hv-cinder-82880 May 10 20:33:19.223771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-801a6c13-4027-4fd6-8c94-3b0418acfd86 req-3f182edb-543c-4ddf-ba19-123070ee5685 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030441 May 10 20:33:19.224367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 666/1318] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:54.082607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:54.083326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:54.089389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:54.089839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:54.090646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:54.091085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:54.114171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d41d508a-2aaf-4cf0-8936-a503e3889f72 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299/ips" status: 200 len: 148 microversion: 2.1 time: 0.036329 May 10 20:33:54.118472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 667/1319] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:33:54 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:34:54.197788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 20:34:54.281730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:54.282251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:54.288016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:54.288458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:54.289363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:54.289792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:54.313486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:34:54.610190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-05f89409-e0b3-4cda-9665-e805e5e94600 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 204 len: 0 microversion: 2.1 time: 0.413857 May 10 20:34:54.610784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 668/1320] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:34:54 2022] DELETE /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:34:54.619525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:54.625827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:54.626942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:54.627386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:54.628815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:54.629251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:54.756942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:54.764319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c7d27fd-33fd-4d99-bc90-2515ed98314f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1681 microversion: 2.1 time: 0.148769 May 10 20:34:54.764891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 669/1321] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:34:54 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:55.780770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:55.781418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:55.788888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:55.789319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:55.790104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:55.790543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:55.796438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 48170. May 10 20:34:55.922779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:55.930107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-32649f22-8183-4985-bd66-b0d849447003 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1681 microversion: 2.1 time: 0.153200 May 10 20:34:55.930679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 670/1322] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:34:55 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:56.863553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-3896c9f8-e1c0-452e-b2ed-e83b86c100ef req-67a3645d-43ff-4779-a15f-3833b99a8de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41ee43-26c2-4b80-b44d-1efb5a10b299", "name": "network-vif-deleted", "tag": "763e6174-5661-49a0-b0bb-40d39fde3357"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:56.872228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3896c9f8-e1c0-452e-b2ed-e83b86c100ef req-67a3645d-43ff-4779-a15f-3833b99a8de0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:56.875546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3896c9f8-e1c0-452e-b2ed-e83b86c100ef req-67a3645d-43ff-4779-a15f-3833b99a8de0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:56.885874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-3896c9f8-e1c0-452e-b2ed-e83b86c100ef req-67a3645d-43ff-4779-a15f-3833b99a8de0 service nova] Creating event network-vif-deleted:763e6174-5661-49a0-b0bb-40d39fde3357 for instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 on hv-cinder-82880 May 10 20:34:56.890821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-3896c9f8-e1c0-452e-b2ed-e83b86c100ef req-67a3645d-43ff-4779-a15f-3833b99a8de0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031041 May 10 20:34:56.891655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 671/1323] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:34:56.951962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:56.952892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:56.961238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:56.961873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:56.962931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:56.963469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:57.037361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:57.045478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fe84a30c-8f65-442a-8f9d-f5ef7b345af0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 200 len: 1613 microversion: 2.1 time: 0.099473 May 10 20:34:57.046540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 672/1324] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:34:56 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:58.062789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:58.063414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:58.070211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:58.070666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:58.071475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:58.071915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:58.085390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 HTTP/1.1 May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:34:58.087055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:34:58.089003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'cc41ee43-26c2-4b80-b44d-1efb5a10b299'} May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:34:58.089992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:34:58.091766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:34:58.093466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:34:58.093466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f353e564-0d76-4aee-be05-a88186906ed5 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 404 len: 111 microversion: 2.1 time: 0.029538 May 10 20:34:58.093466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 673/1325] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:34:58 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:34:58.100675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-73c499bb-1aaf-4523-891f-55c84d81f1a7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '.version_select at 0x7f60291a3ee0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:58.199995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-73c499bb-1aaf-4523-891f-55c84d81f1a7 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499365591" status: 202 len: 0 microversion: 2.1 time: 0.106584 May 10 20:34:58.200569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 674/1326] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 20:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499365591 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:34:58.992250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f33ed378-99ca-42ae-b4c0-9e06da7b8093 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: .version_select at 0x7f6028dde820>, body: {"keypair": {"name": "tempest-keypair-199234250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCifzzSVkKHNq5psJNG19DO703NQw0+Bwz79EcwdghhzZkfjdaTaztJUj8RIvO9djPr2h2RpBaAKuiXaApkepQYQG5RC46I/O2ESXpyNeDbfcudLc8KFENpRcyOaJK3UMA=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:59.007016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-f33ed378-99ca-42ae-b4c0-9e06da7b8093 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:34:59.010748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-f33ed378-99ca-42ae-b4c0-9e06da7b8093 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:34:59.085365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f33ed378-99ca-42ae-b4c0-9e06da7b8093 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097425 May 10 20:34:59.086026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 675/1327] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 20:34:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:35:01.226747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1153129916", "imageRef": "a5bb6261-57bf-4a9c-b687-41ed625ff253", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97616d50-d128-4d48-95c9-0ecc4a239629"}], "security_groups": [{"name": "tempest-securitygroup--896856285"}], "key_name": "tempest-keypair-199234250", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:01.326742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] validate_networks() for [('97616d50-d128-4d48-95c9-0ecc4a239629', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:35:01.679417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:35:01.679851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:35:01.680361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:35:01.680790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:35:01.681206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:35:01.690494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:01.690950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:01.691770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:01.692210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:01.708913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:35:01.712790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Getting quotas for user 04ce1bdd6a234177ba7745d19d6fd950 and project 1d1c68d15d634e81acba3ca215f5548c. Resources: {'instances', 'ram', 'cores'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:35:01.724034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:35:01.726280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5bb6261-57bf-4a9c-b687-41ed625ff253',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:35:01.902996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7059c49f-c9af-4d89-8b53-1b414d30a52c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681719 May 10 20:35:01.903568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 676/1328] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 20:35:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 20:35:01.913864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c50cd168-fa2b-4332-b7d1-7bd543f3276c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:01.914501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c50cd168-fa2b-4332-b7d1-7bd543f3276c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:01.967728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c50cd168-fa2b-4332-b7d1-7bd543f3276c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:01.974652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c50cd168-fa2b-4332-b7d1-7bd543f3276c tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1241 microversion: 2.1 time: 0.064462 May 10 20:35:01.975227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 677/1329] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:01 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:02.991840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:02.992461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:03.000387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:03.000845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:03.001665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:03.002116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:03.068325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:03.075760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e43b52c2-d2a9-416a-98ad-35f11120bf28 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1237 microversion: 2.1 time: 0.087718 May 10 20:35:03.076335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 678/1330] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:02 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:04.092879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:04.093566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:04.100131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:04.100579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:04.101618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:04.102055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:04.173741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:04.181208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4704f95a-38b8-4a94-b929-bab5c2f097e2 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1299 microversion: 2.1 time: 0.092299 May 10 20:35:04.181781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 679/1331] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:04 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:05.198482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:05.199185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:05.206258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:05.206707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:05.207540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:05.207978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:05.399734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:05.407550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b9931c0-0511-4b62-a3de-d614fc3ceb10 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.213179 May 10 20:35:05.408131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 680/1332] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:05 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:05.413452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-830715af-b113-424f-adf5-d2d038cb5888 req-a8aadae3-87e6-4f29-8fbd-ac848a42303e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f901499e-4683-464c-99fa-fcac3177ce05", "tag": "de779ba3-95d2-4c5b-b377-c9366cb89c51"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:05.423831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-830715af-b113-424f-adf5-d2d038cb5888 req-a8aadae3-87e6-4f29-8fbd-ac848a42303e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:05.424719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-830715af-b113-424f-adf5-d2d038cb5888 req-a8aadae3-87e6-4f29-8fbd-ac848a42303e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:05.435906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-830715af-b113-424f-adf5-d2d038cb5888 req-a8aadae3-87e6-4f29-8fbd-ac848a42303e service nova] Creating event network-changed:de779ba3-95d2-4c5b-b377-c9366cb89c51 for instance f901499e-4683-464c-99fa-fcac3177ce05 on hv-cinder-82880 May 10 20:35:05.441368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-830715af-b113-424f-adf5-d2d038cb5888 req-a8aadae3-87e6-4f29-8fbd-ac848a42303e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 May 10 20:35:05.442038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 681/1333] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:06.426402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:06.427028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:06.433194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:06.433649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:06.434453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:06.434906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:06.561678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:06.569142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a6fa432-1d3d-4faf-88cd-43bb4178dfc4 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.148243 May 10 20:35:06.569718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 682/1334] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:06 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:07.585634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:07.586300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:07.592578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:07.593028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:07.593796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:07.594267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:07.719564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:07.727311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b7f9f672-6df3-46ce-bf62-ac079c3dd253 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.145611 May 10 20:35:07.727882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 683/1335] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:07 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:08.744161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:08.744846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:08.751324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:08.751770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:08.752625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:08.753039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:08.889089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:08.897927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-878477ee-1712-4532-861c-346fed323d90 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.157872 May 10 20:35:08.898551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 684/1336] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:08 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:09.915444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:09.916110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:09.922340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:09.922799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:09.923578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:09.924018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:10.048070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:10.055215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c5169cf-8c52-482d-9030-a71457d95599 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.143748 May 10 20:35:10.055787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 685/1337] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:09 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:10.668707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-65051efb-b75a-43bf-8a7d-09c603ed0ab2 req-334efe40-484f-4b1f-a0cc-a47af1fee93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f901499e-4683-464c-99fa-fcac3177ce05", "name": "network-vif-plugged", "status": "completed", "tag": "de779ba3-95d2-4c5b-b377-c9366cb89c51"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:10.677006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-65051efb-b75a-43bf-8a7d-09c603ed0ab2 req-334efe40-484f-4b1f-a0cc-a47af1fee93e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:10.677481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-65051efb-b75a-43bf-8a7d-09c603ed0ab2 req-334efe40-484f-4b1f-a0cc-a47af1fee93e service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:10.688099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-65051efb-b75a-43bf-8a7d-09c603ed0ab2 req-334efe40-484f-4b1f-a0cc-a47af1fee93e service nova] Creating event network-vif-plugged:de779ba3-95d2-4c5b-b377-c9366cb89c51 for instance f901499e-4683-464c-99fa-fcac3177ce05 on hv-cinder-82880 May 10 20:35:10.693787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-65051efb-b75a-43bf-8a7d-09c603ed0ab2 req-334efe40-484f-4b1f-a0cc-a47af1fee93e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028749 May 10 20:35:10.694417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 686/1338] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:35:11.073294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:11.073924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:11.080716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:11.081164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:11.081930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:11.082400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:11.210054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:11.217255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8d80b143-a68f-4761-9136-63512a5a2b0b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1366 microversion: 2.1 time: 0.148736 May 10 20:35:11.217836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 687/1339] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:11 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:12.234770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:12.235432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:12.242442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:12.242906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:12.243690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:12.244125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:12.376624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:12.384410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d59a313-174f-4ac2-9377-8508219be46a tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1555 microversion: 2.1 time: 0.153456 May 10 20:35:12.384999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 688/1340] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:35:12 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:35:12.400262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:12.400750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:12.406376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:12.406825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:12.407622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:12.408590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:12.483630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-14fec18f-b21d-4737-8399-99f0e97954d0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086941 May 10 20:35:12.484265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 689/1341] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 20:35:12 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:35:13.761551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-b456b8c0-06dd-4358-8a98-5cc68c6bb215 req-68205e09-1f64-4679-902a-87ff2a729791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f901499e-4683-464c-99fa-fcac3177ce05", "tag": "de779ba3-95d2-4c5b-b377-c9366cb89c51"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:13.769555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b456b8c0-06dd-4358-8a98-5cc68c6bb215 req-68205e09-1f64-4679-902a-87ff2a729791 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:13.770001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b456b8c0-06dd-4358-8a98-5cc68c6bb215 req-68205e09-1f64-4679-902a-87ff2a729791 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:13.781257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-b456b8c0-06dd-4358-8a98-5cc68c6bb215 req-68205e09-1f64-4679-902a-87ff2a729791 service nova] Creating event network-changed:de779ba3-95d2-4c5b-b377-c9366cb89c51 for instance f901499e-4683-464c-99fa-fcac3177ce05 on hv-cinder-82880 May 10 20:35:13.786787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-b456b8c0-06dd-4358-8a98-5cc68c6bb215 req-68205e09-1f64-4679-902a-87ff2a729791 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029463 May 10 20:35:13.787627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 690/1342] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:35:43.402642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:43.403302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:43.409244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.409696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.410494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.410934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.433850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e8d6e515-2f89-4cfc-946f-50a774e8d03b tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05/ips" status: 200 len: 149 microversion: 2.1 time: 0.036081 May 10 20:35:43.434550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 691/1343] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:35:43 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:36:58.905161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:58.906274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:58.912141 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:58.912584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:58.913384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:58.913819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:58.937950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:36:59.204850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a1e3d5a-1975-4ba7-9dbd-a6416aa55e76 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 204 len: 0 microversion: 2.1 time: 0.304067 May 10 20:36:59.205446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 692/1344] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:36:58 2022] DELETE /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:36:59.214031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:59.218610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:59.221215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:59.221664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:59.222460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:59.222899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:59.354163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:59.361881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3416b790-895a-4c3b-8d3b-357822fe55d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151922 May 10 20:36:59.362481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 693/1345] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:36:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:00.379432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:00.380058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:00.386349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:00.386801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:00.387578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:00.388020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:00.513479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:00.521752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-da39757f-f76a-418f-814d-ef093dd8173a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146283 May 10 20:37:00.522356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 694/1346] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:00 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:01.539062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:01.539703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:01.546574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:01.548225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:01.549011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:01.549452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:01.681059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:01.689014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85107368-e7b7-4985-adbf-4a6d2779e493 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153812 May 10 20:37:01.689579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 695/1347] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:01 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:02.706548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:02.707185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:02.713316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:02.713758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:02.714551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:02.714982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:02.840665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:02.848465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58230989-f293-4c13-91ec-4d378ae9f41f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146449 May 10 20:37:02.849042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 696/1348] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:03.865489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:03.866164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:03.872370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:03.872821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:03.873589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:03.874024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:04.005982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:04.013815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3aa4636e-f6d1-4341-b1f3-f319dd8e0d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152358 May 10 20:37:04.014419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 697/1349] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:05.031406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:05.032729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:05.039028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:05.039501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:05.040261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:05.040709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:05.169821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:05.177686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f004c423-77b6-4bbd-a01b-4c262a7ee629 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150209 May 10 20:37:05.178311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 698/1350] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:06.194805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:06.195520 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:06.201621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:06.202064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:06.202847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:06.203280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:06.331432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:06.339123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ea131f12-4c2f-4caa-a7f2-ce051227b67b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148210 May 10 20:37:06.339689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 699/1351] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:07.356738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:07.357395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:07.363609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:07.364052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:07.364808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:07.365251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:07.493619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:07.501411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7175e7b4-2d55-4b5e-ab4e-9745e267ce5a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148544 May 10 20:37:07.501981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 700/1352] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:07 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:08.518423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:08.519083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:08.525286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:08.525918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:08.526708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:08.527138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:08.651723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:08.660111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7489de15-6047-437e-993a-13f6e79c386e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145616 May 10 20:37:08.660691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 701/1353] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:08 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:09.677095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:09.677791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:09.684047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:09.684499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:09.685272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:09.685709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:09.812216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:09.820419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a2c9577a-6e13-4d93-a316-73a464cbde15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147195 May 10 20:37:09.820996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 702/1354] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:10.838181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:10.838789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:10.845487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:10.845927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:10.846713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:10.847146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:10.973666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:10.981311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fe9e0491-979c-4b0d-b505-5a34b7aed424 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147068 May 10 20:37:10.981876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 703/1355] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:12.000907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:12.001616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:12.007964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:12.008408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:12.009174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:12.009604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:12.145343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:12.153961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-292c8d38-6a80-4567-8357-f2c3ce96fe4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.157469 May 10 20:37:12.154500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 704/1356] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:13.171679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:13.172928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:13.179540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:13.180111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:13.180889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:13.181322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:13.312408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:13.320467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-096344c9-0415-4fd6-ad4f-68a54ce162d6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152710 May 10 20:37:13.321046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 705/1357] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:14.337794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:14.339164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:14.346174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:14.346629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:14.347407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:14.347847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:14.472994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:14.480736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bc9953ed-cfd8-4de9-a8eb-c5b035954815 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146728 May 10 20:37:14.481314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 706/1358] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:15.497544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:15.498177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:15.505052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:15.505507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:15.506322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:15.506765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:15.638392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:15.647501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d64cfd0-6c7e-4c2f-b418-f0f490f4e35e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153832 May 10 20:37:15.648068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 707/1359] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:15 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:16.664871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:16.665596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:16.675066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:16.676619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:16.677404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:16.677866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:16.803184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:16.810820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-57181737-129a-425d-a0d5-c1ba593ebd93 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149904 May 10 20:37:16.811395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 708/1360] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:17.827616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:17.828811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:17.835206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:17.835657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:17.836461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:17.836897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:17.962297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:17.970672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fbef7b36-6b01-46f0-8506-aaed7773b646 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146894 May 10 20:37:17.971246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 709/1361] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:18.988053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:18.993026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:18.995259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.995711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.996483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.996911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:19.128045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:19.135776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d1d781c4-026f-45fb-ac25-ce72af99b46b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152218 May 10 20:37:19.138362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 710/1362] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:18 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:20.152725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:20.153432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:20.160399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:20.160844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:20.161612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:20.162049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:20.286176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:20.293954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-140b29eb-5212-4363-ad4e-9556558f8f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145091 May 10 20:37:20.294705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 711/1363] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:21.311306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:21.312745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:21.318489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:21.318932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:21.319699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:21.320129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:21.449088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:21.456914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-45b0bfdb-6ae0-4ba4-bd5e-71fca005d4cf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149718 May 10 20:37:21.457483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 712/1364] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:22.473477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:22.474157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:22.480758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:22.481292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:22.482057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:22.482521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:22.610470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:22.618295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ae2f43b4-0d29-401e-95d8-de6d534bd9d7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148691 May 10 20:37:22.618879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 713/1365] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:22 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:23.635877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:23.636505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:23.644226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.644678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.645449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.645887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.789357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:23.797766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ac93137f-4e93-46e7-b3c8-101371d87a08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.165759 May 10 20:37:23.798373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 714/1366] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:23 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:24.814664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:24.815291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:24.821452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.821900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.822687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.823125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.954827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:24.962489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-14c00f5c-3cb6-45b6-8585-2dcf6e6077b6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152102 May 10 20:37:24.963059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 715/1367] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:25.979706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:25.980365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:25.986749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:25.987201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:25.988018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:25.988409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:26.113097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:26.120786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c3e26935-6b58-41ff-afbf-b75521fa4f32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145124 May 10 20:37:26.121359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 716/1368] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:25 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:27.138528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:27.139167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:27.145452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:27.145895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:27.146686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:27.147118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:27.275889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:27.293417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4e9865ce-af4b-430a-b56e-7b6750cf7fd6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149482 May 10 20:37:27.293417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 717/1369] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:27 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:28.301245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:28.301905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:28.308232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:28.308678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:28.309442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:28.309875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:28.435177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:28.443604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c249ca69-bbb9-4ead-b731-9365f8a24384 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146200 May 10 20:37:28.444178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 718/1370] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:29.460822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:29.461441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:29.467765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:29.468211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:29.468977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:29.469412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:29.596440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:29.604216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b0164366-a29f-4647-b0ae-ba10438d82e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147303 May 10 20:37:29.604791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 719/1371] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:30.620717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:30.621364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:30.627782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:30.628232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:30.629002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:30.629443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:30.755221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:30.763091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-81d02dc6-bba4-4b02-bc0b-5a4ae459ae92 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146232 May 10 20:37:30.763665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 720/1372] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:30 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:31.780045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:31.781238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:31.788862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:31.789314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:31.790430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:31.790939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:31.919301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:31.927546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f8d923f6-67d5-4ce1-868b-601673004ad2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151606 May 10 20:37:31.928122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 721/1373] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:32.944499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:32.945122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:32.951422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:32.951874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:32.952647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:32.953087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:33.081787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:33.089557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1cc7ea3b-96d1-41c6-97a3-48eaaf59b044 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148861 May 10 20:37:33.090153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 722/1374] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:34.106555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:34.107238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:34.114167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:34.114618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:34.115379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:34.115808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:34.240538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:34.248151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-33fa9a73-88be-4399-a3af-f03ba80ac605 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145396 May 10 20:37:34.248721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 723/1375] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:34 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:35.264870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:35.265521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:35.271749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:35.272222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:35.272982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:35.273430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:35.406783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:35.414697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d01170ee-382b-4e2c-ae3f-0712c7a883da tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153771 May 10 20:37:35.415295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 724/1376] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:36.432737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:36.433351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:36.440585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:36.441027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:36.441787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:36.442246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:36.566913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:36.574559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-55afba88-f685-4361-ab60-0211a6453e24 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145676 May 10 20:37:36.575126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 725/1377] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:37.591545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:37.592203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:37.599075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:37.599623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:37.600395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:37.600835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:37.724085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:37.731876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d2d4d0a0-493d-4cc8-bbdf-7e058c0623d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144218 May 10 20:37:37.732453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 726/1378] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:37 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:38.749235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:38.749900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:38.756243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:38.756684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:38.757439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:38.757869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:38.884020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:38.892309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96857b75-2e51-45ad-b0d0-6ed201c7f39f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147039 May 10 20:37:38.892884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 727/1379] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:39.908969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:39.909650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:39.915796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.916240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:39.917009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.917443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:40.044228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:40.051996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f39c7a8-927b-4c0f-a03c-8f82ccc50b30 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147089 May 10 20:37:40.052573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 728/1380] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:41.068963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:41.069581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:41.075856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:41.080419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:41.080419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:41.080419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:41.205319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:41.213213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-05acd364-ffab-4db5-9351-a35a9db18a9c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148102 May 10 20:37:41.213794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 729/1381] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:42.229935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:42.230644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:42.236858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:42.237305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:42.238070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:42.238534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:42.368750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:42.376991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-747086bf-efa0-4ed5-9a0d-81fa760b6406 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150919 May 10 20:37:42.377567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 730/1382] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:43.394326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:43.394975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:43.401246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:43.401700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:43.402502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:43.402941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:43.536772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:43.544558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-996cd1c1-3df9-4de0-903e-58eb9b2fc577 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154069 May 10 20:37:43.545131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 731/1383] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:44.561861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:44.562552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:44.569022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:44.569475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:44.570289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:44.570726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:44.694571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:44.702169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ffe81c5-5a13-40fb-ad95-0d2a4e5decff tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144406 May 10 20:37:44.702733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 732/1384] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:45.718994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:45.719656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:45.725913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:45.726402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:45.727173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:45.727615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:45.861369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:45.869023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d372505-ee62-41e7-b5ba-a393d1391a68 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153914 May 10 20:37:45.869588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 733/1385] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:46.885720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:46.886411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:46.893293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:46.893736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:46.894536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:46.894969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:47.022407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:47.030166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6dfa68d4-eee0-4253-a168-46914efd9818 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148400 May 10 20:37:47.030741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 734/1386] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:46 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:48.046917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:48.047592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:48.053725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:48.054200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:48.054962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:48.055395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:48.181627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:48.190210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-865a3529-b886-4b74-93d3-f936fca868fb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147056 May 10 20:37:48.190788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 735/1387] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:49.206914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:49.207560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:49.213818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:49.214301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:49.215125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:49.215557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:49.389422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:49.397181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c349b82f-3063-40e7-becb-dc633d011933 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.194089 May 10 20:37:49.397764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 736/1388] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:49 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:50.414938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:50.415636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:50.422875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:50.423316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:50.424083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:50.424517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:50.552293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:50.560062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d4931c3-0717-4771-b079-d4329e026790 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149017 May 10 20:37:50.560667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 737/1389] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:51.577754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:51.578416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:51.584711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:51.585156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:51.585922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:51.586415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:51.710952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:51.719318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-39325fdb-1ac3-4709-8d3a-5fe32d7e4ea3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145894 May 10 20:37:51.719907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 738/1390] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:51 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:52.736872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:52.737510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:52.743838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:52.744291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:52.745061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:52.745501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:52.873816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:52.881665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9e4be7c6-70a0-4f61-8772-7de0f368f6a2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149299 May 10 20:37:52.882301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 739/1391] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:53.898652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:53.899300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:53.905680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:53.906430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:53.907811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:53.907811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:54.031287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:54.039299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2fe4a0b3-7235-4cd2-9378-63aacb895088 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144500 May 10 20:37:54.039880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 740/1392] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:55.056761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:55.057428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:55.064820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:55.065103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:55.065876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:55.066348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:55.197483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:55.205835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ec310e2-e718-4867-97d0-3fe3011ab6df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152936 May 10 20:37:55.206474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 741/1393] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:56.223257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:56.223942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:56.229816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.230303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.231061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.231489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.355123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:56.363782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80ad6eed-b17e-4c2d-a512-3c2de1272a6e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144317 May 10 20:37:56.364356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 742/1394] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:56 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:57.381349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:57.381989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:57.388168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:57.388613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:57.389472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:57.389910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:57.518247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:57.525900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-edf59995-1328-462e-8b1d-0b028a9e5e9d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148556 May 10 20:37:57.526503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 743/1395] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:57 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:58.542731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:58.543415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:58.550143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:58.550656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:58.551427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:58.551862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:58.679574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:58.687686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-601fbf32-c86c-4cfa-8ceb-9ff76655dac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148727 May 10 20:37:58.688413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 744/1396] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:58 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:37:59.704669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:59.705309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:59.711543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:59.711997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:59.712771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:59.713237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:59.838183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:59.846473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-76310536-224d-4a98-a368-828b659770a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145720 May 10 20:37:59.847054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 745/1397] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:37:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:00.864076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:00.864710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:00.870944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:00.871404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:00.872178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:00.872615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:01.049570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:01.057244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db5fea8d-4f40-4e0c-8c7c-b4d2e7694ff1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.197125 May 10 20:38:01.057833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 746/1398] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:00 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:02.074705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:02.085357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:02.085357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:02.085357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:02.085357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:02.085777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:02.210732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:02.218706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ae33322-dd11-4659-8fdb-dc59b46b377e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147837 May 10 20:38:02.219448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 747/1399] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:03.235770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:03.236449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:03.245889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:03.245889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:03.245889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:03.245889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:03.375829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:03.383603 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-370ca6ea-7e47-4a81-9a74-81e783030d4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152456 May 10 20:38:03.384167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 748/1400] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:04.400343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:04.400972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:04.407690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:04.408126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:04.408882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:04.409308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:04.534413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:04.542019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0efaaf1c-449a-4119-9743-9e5ad81ff61e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145466 May 10 20:38:04.542610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 749/1401] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:04 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:05.558984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:05.559639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:05.566308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:05.566754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:05.567524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:05.567953 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:05.692090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:05.700085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-18e08194-c470-449c-bd66-010d3c405e08 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144982 May 10 20:38:05.700651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 750/1402] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:06.717456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:06.718136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:06.724431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:06.724889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:06.725663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:06.726124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:06.853889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:06.862176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-feb2b60e-b619-4772-b6ba-92046f0900d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148518 May 10 20:38:06.862754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 751/1403] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:07.879629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:07.880310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:07.886523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:07.886978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:07.887750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:07.888800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:08.019860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:08.027717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6f409264-06e4-4a6f-84cb-651e213d423d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152061 May 10 20:38:08.028297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 752/1404] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:07 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:09.044223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:09.044915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:09.051182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.051656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.052412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.052849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.188687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:09.196429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f7f7a5c2-47c9-4115-84bf-09107bde76fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.156072 May 10 20:38:09.197010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 753/1405] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:10.213987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:10.214714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:10.221532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:10.221981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:10.222783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:10.223225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:10.349830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:10.357546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-861faacf-063c-4cd8-ae2c-67b71ff3d3c1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147443 May 10 20:38:10.358134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 754/1406] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:11.375008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:11.375650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:11.381812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:11.382299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:11.383066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:11.383501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:11.526923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:11.533722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-edf0cdc3-f4a8-4d6e-bd0f-b06200b73330 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.163236 May 10 20:38:11.534333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 755/1407] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:12.552769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:12.553446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:12.560698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:12.564616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:12.564616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:12.564616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:12.691635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:12.699531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1949e29f-b158-436d-80e6-6c238391cca2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150635 May 10 20:38:12.700285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 756/1408] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:12 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:13.715785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:13.716712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:13.722640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:13.723156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:13.723861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:13.724301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:13.850487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:13.858357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-de938fbc-2a66-4847-8585-bdbf417f9274 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146459 May 10 20:38:13.858942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 757/1409] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:14.875894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:14.876519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:14.882857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:14.883330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:14.884092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:14.884527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:15.012507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:15.020530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-264388a7-d70b-4f42-97d5-7e1f53cd9b7c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149093 May 10 20:38:15.027205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 758/1410] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:16.042017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:16.042695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:16.049029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.049475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.050279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.050718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.178937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:16.187767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ff5aca24-4f02-4d76-ad83-ba8a9bef1487 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149657 May 10 20:38:16.188350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 759/1411] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:17.204833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:17.205459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:17.211720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.212165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:17.212927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.213363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:17.341976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:17.349698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1625708a-7924-4ce7-9644-5bbce632aae9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149320 May 10 20:38:17.350305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 760/1412] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:18.366702 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:18.367421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:18.373593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:18.374037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:18.374827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:18.375257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:18.501584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:18.509322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c37b2156-74a9-4052-aa17-87e99b02da00 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146526 May 10 20:38:18.509898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 761/1413] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:18 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:19.533273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:19.533922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:19.540486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.540928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.541691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.542161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.667449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:19.675792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-09646303-1c76-49bf-b464-fd124e43438c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147530 May 10 20:38:19.676359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 762/1414] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:19 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:20.693019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:20.693660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:20.699923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:20.700890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:20.701670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:20.702135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:20.831226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:20.839041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b8d305f0-544d-45e0-91f0-76c5a18a58ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149978 May 10 20:38:20.839660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 763/1415] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:21.855293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:21.855967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:21.862135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:21.862586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:21.863351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:21.863785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:21.990998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:21.999174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb3a2d8c-db66-4cdf-b83f-7a8a92a03560 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147921 May 10 20:38:21.999754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 764/1416] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:23.016509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:23.017190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:23.023495 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:23.023946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:23.024713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:23.025147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:23.159924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:23.168895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cbebcd7e-a87d-4677-8fe6-ce9380e90223 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.156626 May 10 20:38:23.169566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 765/1417] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:23 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:24.190575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:24.191205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:24.197357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:24.197801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:24.198589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:24.199025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:24.325942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:24.333870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8967ac3d-adf1-4bec-86a0-1097dd8ad6f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147146 May 10 20:38:24.334481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 766/1418] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:25.351683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:25.352295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:25.358533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.358978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.359744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.360177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.489080 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:25.496839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7f3fb98-b0d5-4d37-9c35-5aeda3b35656 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149135 May 10 20:38:25.497427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 767/1419] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:25 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:26.513834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:26.514494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:26.520448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.520887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.521638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.522064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.646271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:26.654721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b16c5507-4e40-4e72-a8e4-e86d172e1662 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144842 May 10 20:38:26.655298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 768/1420] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:26 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:27.672369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:27.673003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:27.679318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.679763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.680521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.680951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.804784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:27.813486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5f25ba25-74c9-4559-bb0a-cfa078d227d9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145548 May 10 20:38:27.814054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 769/1421] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:27 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:28.830646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:28.831346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:28.837529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:28.837974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:28.838767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:28.839203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:28.976853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:28.985377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c78bb090-fc96-4a30-9ff7-6d15551a71c5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.158653 May 10 20:38:28.985944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 770/1422] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:30.002385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:30.003164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:30.014112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.014570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.015348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.015784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.143298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:30.152982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cbd2e50e-2e9e-4f52-a1ed-cf3eca0c4c36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154263 May 10 20:38:30.153598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 771/1423] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:31.170874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:31.171505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:31.177791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.178287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.179064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.179509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.309410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:31.317446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82c76092-2639-4665-9533-416a2378d40a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151046 May 10 20:38:31.318021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 772/1424] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:32.334119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:32.334778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:32.342234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:32.342693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:32.343470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:32.343911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:32.468676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:32.476302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-95b72aa2-19ff-4c5a-843b-ac50f393b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146070 May 10 20:38:32.476872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 773/1425] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:33.493364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:33.494010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:33.500312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:33.500761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:33.501527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:33.501964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:33.644219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:33.652307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-60f42bb2-282c-4ded-bcf9-1db78c33adbf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.162809 May 10 20:38:33.653523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 774/1426] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:34.670036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:34.670687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:34.677015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:34.677468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:34.678359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:34.678701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:34.808196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:34.816225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ff04d28b-c04a-4f3c-b1f7-cac379dc3659 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150642 May 10 20:38:34.816800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 775/1427] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:34 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:35.833098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:35.833745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:35.840232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:35.840681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:35.841457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:35.841899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:35.970938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:35.978730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5cb583d8-9709-4da2-9d27-7be76b256082 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149459 May 10 20:38:35.979309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 776/1428] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:36.996342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:36.996992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:37.003191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:37.003640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:37.004409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:37.004850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:37.132970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:37.140619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d9633b2-9a61-4497-8ec0-7874654e23a5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148202 May 10 20:38:37.141196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 777/1429] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:38.156666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:38.157278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:38.163715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:38.164157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:38.164916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:38.165376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:38.295309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:38.302957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fa8e2a4e-406f-4eb6-aa8c-b83d46ce77e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150133 May 10 20:38:38.303522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 778/1430] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:39.320049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:39.320705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:39.327018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:39.327472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:39.328253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:39.328689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:39.458446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:39.466735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a92974a-9334-47c7-93ba-1e41ff2174dd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150571 May 10 20:38:39.467315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 779/1431] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:40.483666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:40.484282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:40.490583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:40.491030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:40.491800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:40.492238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:40.618645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:40.626898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4fe822b1-3444-4b5d-a294-4ac47f12abe5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147147 May 10 20:38:40.627477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 780/1432] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:41.643803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:41.644462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:41.650706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:41.651153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:41.651919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:41.652354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:41.775468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:41.783159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4920710b-e1e3-465b-96bf-b3c0588224c7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.143243 May 10 20:38:41.783727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 781/1433] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:42.800134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:42.800774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:42.807005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:42.807454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:42.808217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:42.809532 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:42.936816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:42.944448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6426687a-0818-4e5e-bb80-09225ffdb3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148290 May 10 20:38:42.945012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 782/1434] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:43.961856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:43.962587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:43.968829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:43.969277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:43.970043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:43.970508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:44.107242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:44.115732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-adf6873f-51fe-4f15-aaee-105a5fd417a1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.157774 May 10 20:38:44.116396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 783/1435] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:45.132566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:45.133255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:45.140562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.141019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.141825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.142315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.270991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:45.278735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-248db3ac-ba04-401d-b31b-8ed8c20a6920 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149999 May 10 20:38:45.279307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 784/1436] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:46.295932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:46.296553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:46.302814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:46.303263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:46.304029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:46.304465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:46.428074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:46.436788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0b5de21a-3993-4a46-9aa3-592806ed0b40 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145159 May 10 20:38:46.437365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 785/1437] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:46 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:47.453491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:47.454142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:47.460461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:47.460909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:47.461681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:47.462140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:47.587437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:47.595688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-386d5f5a-99e4-482b-956e-ef43ddd415e7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146086 May 10 20:38:47.596263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 786/1438] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:47 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:48.618609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:48.619267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:48.628656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:48.629108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:48.629892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:48.630362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:48.763067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:48.770701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1eb633f4-b104-4400-9456-09413181824b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.157851 May 10 20:38:48.771270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 787/1439] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:49.787489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:49.788140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:49.794318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:49.794765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:49.795559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:49.795993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:49.923438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:49.931202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9e51cea2-6a6e-41f6-a1c1-73f766a0b356 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147542 May 10 20:38:49.931781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 788/1440] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:49 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:50.951567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:50.952605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:50.959132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:50.959614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:50.960381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:50.960816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:51.088149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:51.096621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-55bdffa8-1eec-47c7-8f29-3a7c68ae08ea tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151600 May 10 20:38:51.097206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 789/1441] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:52.113014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:52.113711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:52.119992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:52.120466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:52.121241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:52.121687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:52.246211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:52.253876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-842f29a8-e96e-49e6-bc58-ec4e181b6705 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144895 May 10 20:38:52.254508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 790/1442] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:53.272811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:53.273484 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:53.279915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:53.280364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:53.281411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:53.281857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:53.410682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:53.419121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ebebb04-98a4-4dbe-9d1c-fa8a4199014f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150316 May 10 20:38:53.419690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 791/1443] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:54.435982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:54.436600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:54.443052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:54.443502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:54.444277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:54.444716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:54.572254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:54.580563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1c6d2f60-c626-43cf-b50e-ee39c7917c21 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148657 May 10 20:38:54.581369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 792/1444] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:54 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:55.597882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:55.598533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:55.605361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:55.605807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:55.606606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:55.607043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:55.741883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:55.749839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d3625197-5c9d-4a58-9365-9fc7ce1d38ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.155764 May 10 20:38:55.750445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 793/1445] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:56.766672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:56.767314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:56.773148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:56.773602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:56.774407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:56.774849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:56.901964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:56.909661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-028748f6-b807-4de5-a277-eea65fbcdb38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146979 May 10 20:38:56.910263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 794/1446] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:56 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:57.927280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:57.927930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:57.934516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:57.934962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:57.935718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:57.936204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:58.060851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:58.068537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bbc84cf2-4d70-47a8-b055-cf0d86d46625 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145327 May 10 20:38:58.069104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 795/1447] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:57 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:59.085614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:59.086299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:59.093060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:59.093501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:59.094583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:59.094706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:59.222265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:59.230048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e8fef995-d1b8-4b88-bb18-75e0bcad10f8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148371 May 10 20:38:59.230758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 796/1448] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:38:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:00.247840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:00.248510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:00.254768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:00.255218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:00.256020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:00.256454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:00.464537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:00.472492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6caba042-ae09-498d-a8ff-5244fc1c273a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.229039 May 10 20:39:00.473072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 797/1449] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:00 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:00.830750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:00.831350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:00.837280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:00.837810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:00.838687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:00.839226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:00.864447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:39:01.133061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1ac5b386-7965-43c1-afbf-d1b4160f9302 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 204 len: 0 microversion: 2.1 time: 0.309768 May 10 20:39:01.133669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 798/1450] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:39:00 2022] DELETE /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:39:01.191780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-7728aa13-76fe-45ca-9146-cc58d11a2748 req-78d5781b-1a6c-4e61-9b75-8f1468fe3c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43b1f37-3eff-4ece-bf7e-8dc94657366f", "tag": "87aa9ad9-fb81-4369-8056-73c918735898"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:01.199886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7728aa13-76fe-45ca-9146-cc58d11a2748 req-78d5781b-1a6c-4e61-9b75-8f1468fe3c19 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:01.200333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-7728aa13-76fe-45ca-9146-cc58d11a2748 req-78d5781b-1a6c-4e61-9b75-8f1468fe3c19 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:01.211387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-7728aa13-76fe-45ca-9146-cc58d11a2748 req-78d5781b-1a6c-4e61-9b75-8f1468fe3c19 service nova] Creating event network-changed:87aa9ad9-fb81-4369-8056-73c918735898 for instance f43b1f37-3eff-4ece-bf7e-8dc94657366f on hv-cinder-82880 May 10 20:39:01.216802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-7728aa13-76fe-45ca-9146-cc58d11a2748 req-78d5781b-1a6c-4e61-9b75-8f1468fe3c19 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081774 May 10 20:39:01.217390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 799/1451] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:01.222404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:01.223101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:01.229153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:01.230190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:01.230956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:01.231400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:01.450443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:01.459253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eeec3316-a918-4fcb-983a-29a6e0f6c768 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1576 microversion: 2.1 time: 0.240713 May 10 20:39:01.470621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 800/1452] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:01.490253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:01.491650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:01.497850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:01.498458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:01.499357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:01.499889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:01.663999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:01.672312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9d044a1-5431-4209-8034-864d71d36792 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.186191 May 10 20:39:01.672892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 801/1453] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:01 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:02.478017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:02.478727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:02.485011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:02.485460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:02.486274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:02.486722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:02.659106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:02.668651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fccdbb03-de74-40c2-99b3-08e26d51c8bf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1457 microversion: 2.1 time: 0.193960 May 10 20:39:02.669328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 802/1454] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:02 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1457 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:02.690607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:02.691263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:02.697445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:02.697902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:02.699367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:02.699808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:02.826480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:02.834482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f249f0b7-4721-4245-ac74-e21f0c5d87df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147784 May 10 20:39:02.835056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 803/1455] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:03.232253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-04fb32b8-c7a1-4147-b365-21af62ab9d46 req-7b536e5b-d178-4216-8e12-9a8a00991842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b1f37-3eff-4ece-bf7e-8dc94657366f", "name": "network-vif-deleted", "tag": "87aa9ad9-fb81-4369-8056-73c918735898"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:03.240254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-04fb32b8-c7a1-4147-b365-21af62ab9d46 req-7b536e5b-d178-4216-8e12-9a8a00991842 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:03.240709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-04fb32b8-c7a1-4147-b365-21af62ab9d46 req-7b536e5b-d178-4216-8e12-9a8a00991842 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:03.251775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-04fb32b8-c7a1-4147-b365-21af62ab9d46 req-7b536e5b-d178-4216-8e12-9a8a00991842 service nova] Creating event network-vif-deleted:87aa9ad9-fb81-4369-8056-73c918735898 for instance f43b1f37-3eff-4ece-bf7e-8dc94657366f on hv-cinder-82880 May 10 20:39:03.256511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-04fb32b8-c7a1-4147-b365-21af62ab9d46 req-7b536e5b-d178-4216-8e12-9a8a00991842 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028560 May 10 20:39:03.257096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 804/1456] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:03.687588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:03.688264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:03.694493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:03.694945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:03.695716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:03.696152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:03.759850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:03.767703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ce2cd426-5c99-42e3-a1ce-0724ab51118b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085261 May 10 20:39:03.775578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 805/1457] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:03 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:03.851483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:03.852120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:03.857937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:03.858423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:03.859191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:03.859629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:03.985780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:03.997690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b7d2ea9a-7a75-414d-bfac-ac5ab7ce0093 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149868 May 10 20:39:03.998598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 806/1458] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:04.784923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:04.785573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:04.791847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:04.792301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:04.793073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:04.793515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:04.853050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:04.860346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a10ec21-a498-4b58-bb83-de4f273bfdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079353 May 10 20:39:04.860907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 807/1459] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:05.020778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:05.021394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:05.029281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:05.029281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:05.029281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:05.029281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:05.157598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:05.165350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-22d74f12-cd65-4c68-95d9-58618d0a4623 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148393 May 10 20:39:05.165932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 808/1460] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:05.877207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:05.877882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:05.884250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:05.884705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:05.886053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:05.886572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:05.946431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:05.954263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b655d3a3-5a95-4d4f-a18e-a7da0ee0a565 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080925 May 10 20:39:05.954840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 809/1461] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:06.183817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:06.184432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:06.190336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:06.190784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:06.191550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:06.191980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:06.315978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:06.324309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-48689548-d612-4e23-91da-9d0db3020278 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145208 May 10 20:39:06.324877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 810/1462] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:06.971071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:06.971783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:06.978051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:06.978540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:06.979362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:06.979830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:07.043054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:07.050440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-16350e77-daf0-4b9e-a4c1-616dd56a2e0c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083191 May 10 20:39:07.051012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 811/1463] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:06 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:07.341350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:07.341895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:07.348007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:07.348453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:07.349219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:07.349653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:07.479598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:07.487303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ea023199-a8a4-4908-bdc7-cddecc167971 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150462 May 10 20:39:07.487884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 812/1464] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:07 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:08.068261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:08.068937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:08.075361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:08.075816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:08.076607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:08.077051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:08.137700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:08.145340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f0d245ea-34d4-48bf-b042-b12cda3baedf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081914 May 10 20:39:08.145908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 813/1465] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:08.503715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:08.504335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:08.510567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:08.511023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:08.511791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:08.512225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:08.638201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:08.645924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-204ea0e8-a964-453e-9ddd-625b587bbc2b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146105 May 10 20:39:08.646554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 814/1466] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:08 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:09.161317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:09.161923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:09.168264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:09.168711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:09.169479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:09.169917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:09.229968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:09.237289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-62028b06-ad8c-4358-b564-4d076726ac6e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079832 May 10 20:39:09.237858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 815/1467] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:09 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:09.663100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:09.663720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:09.670422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:09.670869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:09.671633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:09.672077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:09.796010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:09.803706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cb9a6e7e-5252-46de-855e-c5b2bb84498e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144572 May 10 20:39:09.804277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 816/1468] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:10.254809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:10.255521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:10.262370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:10.262823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:10.263600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:10.264041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:10.327824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:10.335174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d9f3927-e406-4311-9a64-2691c49452a1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084289 May 10 20:39:10.335745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 817/1469] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:10.820754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:10.821379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:10.827970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:10.828431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:10.829207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:10.829649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:10.952814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:10.960497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0830b0bc-5f5e-435d-96ad-8f7f23a910d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.143602 May 10 20:39:10.961070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 818/1470] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:11.353655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:11.354319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:11.360574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:11.361021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:11.361796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:11.362287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:11.421623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:11.429214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9e351587-8a7f-4157-a545-dd6b55832619 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079413 May 10 20:39:11.429794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 819/1471] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:11 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:11.977090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:11.977713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:11.984214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:11.984665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:11.985434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:11.985872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:12.112029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:12.120608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9faee738-3a04-4dfc-895c-1cde859a53e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147371 May 10 20:39:12.121228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 820/1472] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:12.446836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:12.447483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:12.453804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:12.454290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:12.455066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:12.455504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:12.515266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:12.522492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0887b639-089a-487c-ae20-0534c5541002 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079636 May 10 20:39:12.523062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 821/1473] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:13.138347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:13.138996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:13.144942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:13.145397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:13.146195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:13.146639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:13.271277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:13.279358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e4b2a85e-98bd-42ca-a82f-1214eda6cd64 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145473 May 10 20:39:13.284262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 822/1474] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:13.539474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:13.540156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:13.548115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:13.548115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:13.548480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:13.548737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:13.617725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:13.625777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b881d7c2-943f-4b03-8dc3-c10e3b76dd9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.090145 May 10 20:39:13.626408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 823/1475] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:13 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:14.297118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:14.297724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:14.303591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:14.304030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:14.304787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:14.305215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:14.429314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:14.437624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9af7d23c-c410-45d3-9f70-236c10956f6f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144841 May 10 20:39:14.438228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 824/1476] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:14.643118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:14.643749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:14.649929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:14.650414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:14.651187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:14.651627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:14.720043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:14.727483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1bdf56b4-17df-4a04-b8bf-26f7c6416c7a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.088294 May 10 20:39:14.728053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 825/1477] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:14 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:15.455084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:15.455704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:15.461982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:15.462479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:15.463250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:15.463689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:15.759198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:15.766997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-95ec4250-4808-478a-8272-0f8c01b8ee9e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.315826 May 10 20:39:15.767556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 826/1478] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:15 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:15.771898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:15.772506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:15.777888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:15.781583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:15.781583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:15.781583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:15.838756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:15.846433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-20980f7d-5eaa-4ab8-8763-d31dcdd41245 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077918 May 10 20:39:15.846992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 827/1479] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:16.784010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:16.784676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:16.791404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.791521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:16.792328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.792909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:16.917739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:16.925533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b24b7b0f-5203-4fc9-b14c-e0010852ff0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145337 May 10 20:39:16.926188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 828/1480] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:16.930516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:16.931125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:16.937246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.937700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:16.938504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.938949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:17.001039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:17.008227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e6dc2789-cf7d-40c9-908a-22eec5ee1e48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081111 May 10 20:39:17.008788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 829/1481] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:17.943249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:17.943929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:17.950241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:17.950696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:17.951473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:17.951914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:18.076383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:18.083965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fcf1587c-7bbc-4957-9552-3610fbd7258f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144619 May 10 20:39:18.084518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 830/1482] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:18.088766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:18.089900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:18.095220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:18.095665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:18.096427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:18.096859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:18.157969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:18.165234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-57946507-1d5c-49e3-a51c-011fd7d91fed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079790 May 10 20:39:18.165788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 831/1483] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:19.101623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:19.102379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:19.109139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:19.109586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:19.110391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:19.110834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:19.238753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:19.246643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d96ff229-7f17-4444-bd49-9847b062937a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148901 May 10 20:39:19.247197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 832/1484] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:19 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:19.251444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:19.252038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:19.257338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:19.257780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:19.258574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:19.259023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:19.318732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:19.326582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfbd3eab-33ab-4e36-87d0-e823311ac928 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078469 May 10 20:39:19.327133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 833/1485] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:20.264319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:20.265046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:20.271562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:20.272011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:20.272779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:20.273213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:20.399084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:20.406873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f20c10fd-d274-4d7c-b947-5df858efaef5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146971 May 10 20:39:20.407428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 834/1486] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:20.411712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:20.412307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:20.417735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:20.418213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:20.418976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:20.419405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:20.481776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:20.488934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc04a411-0365-4b09-aa12-381850447186 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080590 May 10 20:39:20.489490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 835/1487] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:21.424545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:21.425197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:21.431550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:21.432005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:21.433049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:21.433487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:21.556910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:21.564817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3023f43f-8e4a-4aa0-95ea-d63d495f27c3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144189 May 10 20:39:21.565385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 836/1488] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:21.570011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:21.570673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:21.576609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:21.577062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:21.577867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:21.578339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:21.637166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:21.644297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-14945222-d6c4-49e2-bd47-4aeab38780fc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077671 May 10 20:39:21.644868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 837/1489] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:21 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:22.582830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:22.583496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:22.590445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:22.590900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:22.591674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:22.592114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:22.727700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:22.739388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f6c67bce-7b65-49a2-8940-342d8711a9ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.160667 May 10 20:39:22.740239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 838/1490] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:22 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:22.747541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:22.748475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:22.756543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:22.756991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:22.757827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:22.758539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:22.825445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:22.832853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e1e03a28-4879-4a97-87b3-a02604fa9a1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.091440 May 10 20:39:22.833414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 839/1491] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:23.757318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:23.757994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:23.764607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:23.765053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:23.765808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:23.766279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:23.892410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:23.900292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6cec9cbc-f23f-4e5d-bbbd-793f87476c4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146872 May 10 20:39:23.900860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 840/1492] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:23 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:23.905753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:23.906376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:23.911836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:23.912286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:23.913052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:23.913485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:23.975980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:23.983305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d56816d3-ed73-40c4-9f1c-396a01b28f09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081514 May 10 20:39:23.983873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 841/1493] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:24.917898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:24.918579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:24.924650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.925093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:24.925847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.926305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.051901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:25.060799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5f652e97-10e5-4381-b93b-e25f33fd5b06 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146851 May 10 20:39:25.061403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 842/1494] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:25.065743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:25.066377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:25.071878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.072331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.073104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.074126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.132960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:25.140780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-adb6faf0-9ce5-4e85-8c78-2c3bef631d09 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078449 May 10 20:39:25.141349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 843/1495] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:25 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:26.078644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:26.079283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:26.085345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.085788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:26.086572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.087030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:26.215607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:26.223333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c70405f0-2548-47f4-a9d8-f5c3de22c007 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148725 May 10 20:39:26.223899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 844/1496] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:26 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:26.228216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:26.228823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:26.234195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.234647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:26.235417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.235854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:26.298477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:26.305704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c2442ee0-ea0b-45a7-9895-9338b2ba0504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080887 May 10 20:39:26.306296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 845/1497] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:27.240223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:27.246762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:27.247690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:27.248137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:27.248909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:27.249345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:27.376012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:27.384106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7489c8ef-0d13-4a36-86a0-c971529ab78b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147781 May 10 20:39:27.384699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 846/1498] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:27 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:27.389782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:27.395224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:27.395865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:27.396316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:27.397092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:27.397531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:27.460244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:27.467577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9b132e2-3d6d-4b48-8c84-765cf7a67d51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081812 May 10 20:39:27.468139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 847/1499] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:28.402236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:28.402944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:28.409191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.409647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.410456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.410900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.538665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:28.546740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cd99f9b3-b2ff-4b35-88a8-265c309a99e2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149000 May 10 20:39:28.556246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 848/1500] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:28.556246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:28.556246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:28.559158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.559633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.560406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.560844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.624029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:28.631443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63b2071c-f669-4344-80cc-9aed1b27ddb4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083182 May 10 20:39:28.632015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 849/1501] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:29.564078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:29.564695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:29.571175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.571630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.572433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.572879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.701586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:29.709224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1251ca4b-0354-4475-9cd6-fb978a5a3d41 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149014 May 10 20:39:29.709786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 850/1502] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:29.714783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:29.715379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:29.720996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.721485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.722321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.722761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.781672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:29.789001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e2845f9-1663-4746-b023-c6d8d4924504 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078269 May 10 20:39:29.789563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 851/1503] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:30.726585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:30.727264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:30.733407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:30.733859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:30.734657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:30.735096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:30.861792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:30.870704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1c3e3afe-617b-4664-b429-dc24fc2e878c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147452 May 10 20:39:30.871299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 852/1504] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:30 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:30.875751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:30.876364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:30.884842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:30.884842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:30.884842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:30.884842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:30.947411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:30.955296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f31cb7ea-d0df-4b31-81ff-02d0812311d8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083054 May 10 20:39:30.955867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 853/1505] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:30 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:31.891704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:31.892345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:31.898587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.899045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:31.899815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.900251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.025285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:32.033581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30a5589d-2060-4fda-9433-7347b34e3e15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145829 May 10 20:39:32.034162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 854/1506] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:32.038429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:32.039023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:32.044321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.044767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.045525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.045960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.105528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:32.112719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8152c2e6-4d05-43ac-b567-3cafa1133077 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077604 May 10 20:39:32.113284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 855/1507] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:33.051056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:33.051749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:33.058899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.059353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.060125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.060563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.188507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:33.196325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-968de2fc-c89d-472a-b31d-909610cc6995 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149312 May 10 20:39:33.196912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 856/1508] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:33.204682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:33.205014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:33.210848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.211307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.212093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.212536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.273767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:33.281274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e123986b-6445-428c-b819-5b99d61e47ff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083432 May 10 20:39:33.281858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 857/1509] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:34.213956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:34.214672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:34.220795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:34.221238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:34.221992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:34.222448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:34.353008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:34.361299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8ab26b6-bb1d-460c-9e98-8ae7353ca3ed tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151215 May 10 20:39:34.361868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 858/1510] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:34 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:34.366245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:34.366848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:34.373057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:34.373513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:34.374352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:34.374794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:34.436948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:34.444345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c1861dbd-cf09-4e42-917b-dfbf09a31a59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081512 May 10 20:39:34.444911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 859/1511] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:35.379040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:35.379690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:35.386502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.386950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.387722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.388160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.513477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:35.522399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c57974c7-f33a-4c68-a5c8-1602ef0891a4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147236 May 10 20:39:35.523024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 860/1512] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:35.527574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:35.528191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:35.534004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.534489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.535293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.535729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.595592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:35.602777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1d48b777-ac31-4350-88a0-f98e9ab63320 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078819 May 10 20:39:35.603345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 861/1513] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:36.539421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:36.540053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:36.546918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:36.547371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:36.548144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:36.548585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:36.677201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:36.685926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cad66abc-0e5d-4dc9-a3f1-9205b0a463fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150321 May 10 20:39:36.686460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 862/1514] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:36.690822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:36.691431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:36.696781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:36.697233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:36.698005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:36.698479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:36.757273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:36.764584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b6adfd8c-36ed-4299-9f87-9418dbbeb10d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077181 May 10 20:39:36.765150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 863/1515] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:37.703553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:37.704194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:37.710434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.710885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.711659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.712097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.837362 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:37.845137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cd30b44-b201-4326-8001-6e0c2a16f3ac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145604 May 10 20:39:37.845715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 864/1516] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:37 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:37.850043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:37.850675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:37.856090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.856544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.857319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.857761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.928740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:37.937055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8b8e3ed3-5d71-4790-956b-e76d2ec20b48 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.090372 May 10 20:39:37.937615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 865/1517] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:38.862256 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:38.862927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:38.869055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:38.869507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:38.870890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:38.871331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:38.997604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:39.007624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-303dfd10-f43b-460c-a9a6-101ada328053 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147166 May 10 20:39:39.007624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 866/1518] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:39.010437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:39.011045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:39.016501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:39.016950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:39.017726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:39.018197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:39.077958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:39.085519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f0d4300-b11e-41cd-bc4e-305924d20882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078492 May 10 20:39:39.086103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 867/1519] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:40.022847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:40.023507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:40.029867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:40.030353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:40.031130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:40.031570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:40.159641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:40.167625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b5d42769-9b2c-4462-9657-a37634c49aab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148578 May 10 20:39:40.168220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 868/1520] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:40.172998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:40.173642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:40.179854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:40.180307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:40.181087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:40.181522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:40.241225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:40.249049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ce75b2f5-3e39-457f-bf72-329fb0219799 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079878 May 10 20:39:40.249616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 869/1521] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:41.185713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:41.186378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:41.192765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:41.195254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:41.195254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:41.195254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:41.327413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:41.335564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af0c6e69-a459-43b1-b67c-ed04d05a945d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154662 May 10 20:39:41.336135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 870/1522] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:41.340572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:41.341197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:41.346792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:41.347251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:41.348649 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:41.349097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:41.414344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:41.421740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4cbde348-145e-4bc0-adfb-3e543cff95ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084658 May 10 20:39:41.422336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 871/1523] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:42.352783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.353482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:42.360395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:42.360838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:42.361595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:42.362026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:42.487431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:42.495208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7be62c7a-73bc-4aa8-8da6-1dd6b2de9810 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146334 May 10 20:39:42.495805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 872/1524] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:42.500186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.500791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:42.506291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:42.506743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:42.507514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:42.507946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:42.570395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:42.578377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-915d7692-4161-430a-9e06-f04d9e2a9d0e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081622 May 10 20:39:42.581943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 873/1525] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:43.512778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:43.513398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:43.519762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:43.520212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:43.520982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:43.521417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:43.649729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:43.657632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b7f09c15-959e-484f-99d6-f9a04f13dbcf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149281 May 10 20:39:43.658238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 874/1526] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:43.662625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:43.663232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:43.668768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:43.669220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:43.669996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:43.670485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:43.730054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:43.737573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0b1c50f-b0d2-4499-9146-16863f77a2fe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078385 May 10 20:39:43.738172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 875/1527] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:44.675107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:44.675774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:44.682428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:44.682824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:44.683593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:44.684032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:44.807928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:44.816675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ac41f422-f922-4fb5-bb8a-f8a4beae7211 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145421 May 10 20:39:44.817284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 876/1528] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:44.821701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:44.822337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:44.827795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:44.828249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:44.829023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:44.829466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:44.891103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:44.898455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f543507-d7d4-4e4f-a865-85f67ef41f75 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080191 May 10 20:39:44.899033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 877/1529] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:44 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:45.833797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:45.834526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:45.840617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:45.841168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:45.841857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:45.842329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:45.973308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:45.981043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c9d5286d-791a-4070-9689-11581414263e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151208 May 10 20:39:45.981618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 878/1530] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:45.985991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:45.986628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:45.992267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:45.992716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:45.993482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:45.993916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:46.052533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:46.060444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f1124ffe-67f5-4a52-a6af-1f5be6e02e49 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077362 May 10 20:39:46.061022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 879/1531] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:46.998646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:46.999310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:47.005118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:47.005560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:47.006466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:47.006900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:47.134972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:47.143216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3eab3e56-5df5-4577-b726-115a4f8d4265 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149721 May 10 20:39:47.143775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 880/1532] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:46 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:47.148075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:47.148672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:47.154654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:47.155163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:47.155925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:47.156357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:47.217042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:47.224257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-38a5bf88-c550-4b60-a687-54730d2fb805 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079558 May 10 20:39:47.224824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 881/1533] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:48.160592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:48.161295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:48.167602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:48.168054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:48.168831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:48.169920 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:48.296280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:48.303937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-94abc4fd-33f4-447e-adad-983378bff81d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147230 May 10 20:39:48.304506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 882/1534] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:48.309074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:48.309681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:48.315102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:48.315555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:48.316325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:48.316767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:48.381127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:48.389000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba554426-9473-4637-85cd-78035dbf8b41 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083557 May 10 20:39:48.389565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 883/1535] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:48 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:49.320699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:49.321346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:49.327675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:49.328118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:49.328904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:49.329338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:49.454413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:49.462048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c4df463c-0a02-43c3-8d34-da23aab24a5c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145250 May 10 20:39:49.462795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 884/1536] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:49 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:49.467075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:49.467671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:49.472977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:49.473423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:49.474258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:49.474691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:49.533691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:49.540993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-255caaa0-de25-43d1-a51a-855a786a1ea5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077273 May 10 20:39:49.541563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 885/1537] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:50.479228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:50.479830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:50.487021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:50.487472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:50.488247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:50.488681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:50.620444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:50.628229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a5f8f92-d370-4cad-941c-47c3e56d5426 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152875 May 10 20:39:50.628810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 886/1538] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:50.633116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:50.633725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:50.639682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:50.640139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:50.640915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:50.641358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:50.701222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:50.708731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b326befd-fe19-425d-a3fd-aeae33fbdb8f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078989 May 10 20:39:50.715564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 887/1539] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:51.645264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:51.645895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:51.652168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:51.652609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:51.653436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:51.653866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:51.799683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:51.807721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85fdf29c-4f2e-4a3f-b241-75a897547ba1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.166391 May 10 20:39:51.808292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 888/1540] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:51 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:51.812827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:51.813435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:51.818925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:51.819378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:51.820149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:51.820591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:51.884846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:51.892170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c983c83-fc41-4244-a105-de09a742d33f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082941 May 10 20:39:51.892744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 889/1541] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:52.824663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:52.825909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:52.832476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:52.832918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:52.833967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:52.834422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:52.959911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:52.967663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5bed04cf-f2c4-45cc-83ca-969f2e3954e0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146896 May 10 20:39:52.968314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 890/1542] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:52.972580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:52.973187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:52.978782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:52.979235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:52.980008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:52.980446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:53.039061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:53.046883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-27e3761e-e26b-4720-b43d-6682cf86ae33 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077703 May 10 20:39:53.047460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 891/1543] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:53.984492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:53.985214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:53.991681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:53.992130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:53.992900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:53.993333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:54.123982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:54.131945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0e2f8757-308f-4346-a5b2-15f15999e39b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151873 May 10 20:39:54.132538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 892/1544] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:54.137077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:54.137674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:54.143064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:54.143507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:54.144259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:54.144688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:54.203723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:54.211096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2df4a1d0-5994-40d0-965c-99e07c62d6a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077635 May 10 20:39:54.211664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 893/1545] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:55.148777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:55.149409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:55.155772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:55.156246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:55.157005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:55.157435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:55.290694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:55.299129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7db72572-dd41-47ed-b5b3-e6a5f0df4cba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154238 May 10 20:39:55.299709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 894/1546] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:55.304128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:55.304740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:55.311035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:55.311487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:55.312257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:55.312698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:55.374794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:55.381984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1de1127a-a4e9-4bb5-9be8-d174c16c15ef tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081334 May 10 20:39:55.382587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 895/1547] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:55 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:56.316733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:56.317393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:56.323395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:56.323852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:56.324624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:56.325721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:56.456180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:56.463929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-edca8802-547b-4445-95ff-3c09f3a74e3a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151225 May 10 20:39:56.464498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 896/1548] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:56 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:56.469685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:56.470308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:56.476084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:56.476541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:56.477320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:56.477788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:56.536831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:56.544731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8360adfe-13bc-4673-8ffd-cab29de82254 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078711 May 10 20:39:56.545298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 897/1549] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:56 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:57.481005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:57.482192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:57.488469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:57.488909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:57.489666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:57.490110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:57.618013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:57.626279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dc0752ca-dff8-4053-b1ec-ef683e755488 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149109 May 10 20:39:57.626838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 898/1550] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:57 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:57.631270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:57.631864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:57.637542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:57.637999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:57.638802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:57.639241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:57.698763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:57.705942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-71c7f72e-2f89-45c8-9305-566c198b5262 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078184 May 10 20:39:57.706537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 899/1551] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:57 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:58.644455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:58.645064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:58.651597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:58.652045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:58.652809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:58.653292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:58.779798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:58.787612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4e470098-4d3b-45a3-ad9e-91b6b8ad6b5e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147091 May 10 20:39:58.788191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 900/1552] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:58 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:58.792516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:58.793121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:58.798588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:58.799044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:58.799819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:58.800258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:58.862631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:58.869879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-90a2b6ea-2d1c-4b16-9c86-776ff31b7321 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080753 May 10 20:39:58.870482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 901/1553] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:59.900349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:59.900976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:59.908573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:59.909127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:59.909917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:59.910394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:00.033633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:00.041278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-52c2e8ae-6f78-4d99-bea8-093ce2226e17 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.240821 May 10 20:40:00.041870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 902/1554] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:39:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:00.046178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:00.046790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:00.052271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:00.052719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:00.053490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:00.053927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:00.114170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:00.121431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1732e6a7-a88e-4914-9adf-6e7bb2076d06 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078605 May 10 20:40:00.122001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 903/1555] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:01.057758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:01.058499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:01.064674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:01.065117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:01.065877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:01.066338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:01.194308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:01.203394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2dc27fb4-cb7d-452f-abe5-40af3b1d3ee0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149773 May 10 20:40:01.203970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 904/1556] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:01 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:01.208467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:01.209074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:01.214778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:01.215232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:01.216004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:01.217098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:01.276405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:01.285493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-23a8ac7a-52de-4c6b-bbc6-8bdd9fa2194c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079751 May 10 20:40:01.285493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 905/1557] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:02.219921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:02.220608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:02.226920 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:02.227375 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:02.228151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:02.228592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:02.355152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:02.363494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96fcb9f4-fab4-44de-a0b4-63b46395aebc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147533 May 10 20:40:02.364063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 906/1558] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:02.368383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:02.368989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:02.374446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:02.374883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:02.375694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:02.376136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:02.441942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:02.449457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f311ce87-b347-4150-a278-8d3cc68664ea tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084440 May 10 20:40:02.450203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 907/1559] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:02 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:03.380790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:03.381469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:03.387559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:03.388031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:03.388793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:03.389224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:03.514339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:03.521889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aec60961-9932-499f-8823-f19a5f0d24a7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145058 May 10 20:40:03.522562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 908/1560] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:03.526846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:03.527448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:03.532781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:03.533229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:03.533981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:03.534439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:03.593308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:03.600489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d4e1278-b33c-4032-9f0b-8eadfd1d03f4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077006 May 10 20:40:03.601057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 909/1561] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:03 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:04.539019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:04.725865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:04.725865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:04.725865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:04.725865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:04.727264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:04.727264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:04.727264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c53193e3-90b8-422c-aa09-1e47ed55514b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153540 May 10 20:40:04.727264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 910/1562] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:04 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:04.727677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:04.727677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:04.727677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:04.727677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:04.728081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:04.728081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:04.760061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:04.767907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-15ca8b86-1813-4c03-8b77-39dbddd071e6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077839 May 10 20:40:04.768473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 911/1563] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:05.705289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:05.705961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:05.712712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:05.713028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:05.713788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:05.714258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:05.839667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:05.848183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a42ee305-c0e2-4cc6-9466-a11e181d8089 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146771 May 10 20:40:05.848754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 912/1564] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:05.853197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:05.853808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:05.859324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:05.859775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:05.860552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:05.860997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:05.922673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:05.929924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30f84313-ea43-4888-851c-74f45e9c3e3c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080231 May 10 20:40:05.930527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 913/1565] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:06.865451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:06.866134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:06.872261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:06.872705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:06.873465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:06.873896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:06.999379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:07.006986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e47b4abd-8842-47b2-be1c-2518d39351fc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145478 May 10 20:40:07.007553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 914/1566] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:07.011879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:07.012476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:07.018611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:07.019061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:07.019824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:07.020259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:07.078864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:07.086014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca8bd3f9-c2a2-4192-b1a5-2ec8a96adf0b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077510 May 10 20:40:07.086600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 915/1567] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:07 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:08.023736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:08.024359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:08.031357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:08.031838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:08.032611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:08.033050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:08.160876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:08.168738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fca2ade7-fcae-42ab-beb8-9032e9da26d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148890 May 10 20:40:08.169473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 916/1568] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:08 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:08.173743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:08.174475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:08.180019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:08.180473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:08.181510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:08.181950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:08.241399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:08.249254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2529d4d0-2178-4cce-9e4f-f4f3633918a7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078933 May 10 20:40:08.249820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 917/1569] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:09.185709 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:09.186370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:09.192655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:09.193096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:09.193863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:09.194331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:09.326754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:09.335333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d1906ed-e2d1-4bee-a56e-039c83a1d557 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154296 May 10 20:40:09.335911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 918/1570] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:09.340353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:09.340963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:09.346506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:09.346953 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:09.347721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:09.348159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:09.409766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:09.416967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2011ba1b-697b-4319-a700-661dffce33b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080118 May 10 20:40:09.417554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 919/1571] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:09 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:10.352514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:10.353207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:10.359463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:10.359911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:10.360677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:10.361113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:10.493607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:10.502101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9d964a8-7675-4290-8e52-23de171d62be tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153450 May 10 20:40:10.502684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 920/1572] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:10.507133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:10.507763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:10.513955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:10.514459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:10.515207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:10.515654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:10.574392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:10.582554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a665f9ef-4c75-47ba-85c8-d96485c04363 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078883 May 10 20:40:10.583136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 921/1573] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:10.997589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:40:10.997867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:40:11.519700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:11.520348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:11.526766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:11.527217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:11.527985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:11.528474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:11.657755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:11.665450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-91078db8-bc20-4863-8b05-e1d8ee68ee23 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149706 May 10 20:40:11.666017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 922/1574] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:11.671021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:11.671655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:11.677017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:11.677467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:11.678307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:11.678756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:11.737895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:11.745176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4e9798b7-e8b5-4277-97f9-d0a02c074451 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078198 May 10 20:40:11.745746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 923/1575] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:11 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:12.683515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:12.684204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:12.690928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:12.691381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:12.692148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:12.692595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:12.817010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:12.824724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca5b969b-5eb9-499e-a777-da5cf0e2331c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145420 May 10 20:40:12.825291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 924/1576] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:12 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:12.829628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:12.830329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:12.835768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:12.836225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:12.837001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:12.837444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:12.899192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:12.907076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ccefa0fe-2383-4799-b1f2-ec22511c13aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080813 May 10 20:40:12.907645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 925/1577] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:13.841556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:13.842220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:13.848422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:13.848866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:13.849641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:13.850096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:13.974341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:13.982534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-61804f8e-99e7-4eb0-816a-2ccf8e5f472c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144928 May 10 20:40:13.983102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 926/1578] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:13.987424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:13.988028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:13.993474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:13.995789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:13.995789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:13.995789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:14.054363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:14.062486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e6ef284f-884f-4b93-a939-f89b8d36baf1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078423 May 10 20:40:14.063048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 927/1579] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:13 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:15.000446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:15.001166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:15.008777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:15.009228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:15.010039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:15.010494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:15.148811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:15.156697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1e3f4d30-08ad-418b-8193-936e8f36baac tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.160900 May 10 20:40:15.157284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 928/1580] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:15.162968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:15.163582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:15.169547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:15.170003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:15.170828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:15.171270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:15.235541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:15.242784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-999a0230-f34b-4d4a-9c10-298d5e10f505 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084569 May 10 20:40:15.243361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 929/1581] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:16.038451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:40:16.039449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:40:16.173715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:16.174356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:16.181026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:16.181471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:16.182276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:16.182714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:16.310767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:16.322605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-503bb32c-c121-4a45-be55-08a6a5f54696 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152357 May 10 20:40:16.323443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 930/1582] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:16.330881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:16.331845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:16.340034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:16.341357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:16.342571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:16.343241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:16.409525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:16.416933 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c903ba6e-4e14-44af-96bf-57fcdd00e1bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.092189 May 10 20:40:16.417503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 931/1583] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:17.341081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:17.341762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:17.348014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:17.348465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:17.349230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:17.349665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:17.474480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:17.482746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aeaea92c-1393-4ddd-a407-e49aea78ea15 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146127 May 10 20:40:17.483305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 932/1584] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:17.487755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:17.488356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:17.493750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:17.494232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:17.495000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:17.495435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:17.553931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:17.561873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2eb66ebb-6266-402d-a6ba-b286fc298625 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077646 May 10 20:40:17.562483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 933/1585] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:17 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:18.499521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:18.500140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:18.506512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:18.506967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:18.507744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:18.508186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:18.644648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:18.652409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f21def58-eeba-4aea-8476-0e286b5dd40c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.156751 May 10 20:40:18.653604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 934/1586] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:18 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:18.657925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:18.658537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:18.663865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:18.664313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:18.665083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:18.665517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:18.723904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:18.731300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-33105811-b062-49aa-b88f-c429ef4f86a0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.076680 May 10 20:40:18.731897 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 935/1587] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:19.670677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:19.671338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:19.677623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:19.678124 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:19.678904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:19.679363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:19.802877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:19.811371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9f9a5f8-6f73-43fc-b12a-b616b38d6f01 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145245 May 10 20:40:19.811939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 936/1588] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:19 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:19.816269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:19.816879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:19.822305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:19.822760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:19.823530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:19.823970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:19.887817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:19.895114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-64e956b5-1e1d-4927-af60-4c15bedebeb9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082244 May 10 20:40:19.895684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 937/1589] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:20.828136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:20.828759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:20.835068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:20.839492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:20.839492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:20.839492 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:20.961931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:20.970104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7c327bb-fefc-481f-b05c-3b07e6360de4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146345 May 10 20:40:20.970792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 938/1590] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:20.975147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:20.975748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:20.981599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:20.982058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:20.982865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:20.983307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:21.050550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:21.058253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b474f35c-7916-4337-9e7c-ad062a1d24bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.086506 May 10 20:40:21.058827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 939/1591] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:21.987352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:21.988036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:21.994385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:21.994826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:21.995585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:21.996010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:22.124919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:22.132545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0596ed4-d576-43b1-8dbf-4aae2bfddf8a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149068 May 10 20:40:22.133178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 940/1592] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:22.137431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:22.138034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:22.143915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:22.144357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:22.145113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:22.145547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:22.204508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:22.211779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c1226466-ef86-42da-9a88-c6fcf87d9951 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077656 May 10 20:40:22.212331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 941/1593] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:23.148942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:23.149557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:23.155966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:23.156413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:23.157180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:23.157612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:23.289758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:23.298214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e8343543-d56c-4fba-abeb-ff36747a89af tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153160 May 10 20:40:23.298772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 942/1594] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:23 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:23.409421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:23.410045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:23.415812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:23.416268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:23.417051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:23.417491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:23.479700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:23.487513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-20711a4c-4648-4181-836c-1310b20d6882 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.187739 May 10 20:40:23.488117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 943/1595] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:24.315523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:24.316234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:24.322604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:24.323047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:24.323808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:24.324236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:24.710190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:24.718643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-312a8f1d-9687-422d-a3e0-1b8e39c03b62 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.406955 May 10 20:40:24.719206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 944/1596] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:24.723498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:24.724102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:24.729442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:24.729894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:24.730721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:24.731162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:24.791039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:24.798251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b4e284bd-4bb2-4f2d-bc1e-dd40549034b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078089 May 10 20:40:24.798814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 945/1597] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:25.736039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:25.736722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:25.742996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:25.743502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:25.744269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:25.744700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:25.876302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:25.882871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7e965db-ac8f-42fd-a947-8a332d2e5070 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.150654 May 10 20:40:25.883445 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 946/1598] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:25 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:25.888424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:25.889034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:25.894524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:25.894984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:25.895757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:25.896204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:25.957167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:25.963016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-52cd3fa2-8b73-4fa7-a9c5-cf54cc18ebbd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078646 May 10 20:40:25.963572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 947/1599] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:25 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:26.900885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:26.901528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:26.907719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:26.908161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:26.908923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:26.909354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:27.033070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:27.040749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-70c337ac-5c39-422e-8b33-ab331aecfc28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.143932 May 10 20:40:27.041318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 948/1600] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:26 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:27.046285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:27.046890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:27.052267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:27.052716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:27.053480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:27.053918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:27.115224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:27.122755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-10465891-d001-43e7-96f4-ed7ff33120d7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080513 May 10 20:40:27.123316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 949/1601] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:28.058596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:28.059762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:28.066010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:28.066491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:28.067269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:28.067712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:28.193817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:28.201575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-56ec6b73-c4d0-4c73-bd36-ef2edcddea04 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147150 May 10 20:40:28.202157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 950/1602] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:28.206641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:28.207245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:28.212928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:28.213384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:28.214195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:28.214639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:28.273209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:28.280456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b8bba90d-5d70-453a-9550-9fab304abd05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077349 May 10 20:40:28.281003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 951/1603] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:29.218800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:29.219450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:29.225722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:29.226223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:29.226981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:29.227416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:29.353130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:29.360994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad07687e-b485-47b4-9428-4c47d62be4f9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146760 May 10 20:40:29.361568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 952/1604] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:29.365988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:29.366632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:29.372579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:29.373032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:29.373805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:29.374273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:29.435418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:29.442698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b375b8c5-cc8a-4f5e-bfa1-978df7e92957 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080198 May 10 20:40:29.443260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 953/1605] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:30.377912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:30.378621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:30.384952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:30.385404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:30.386206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:30.387137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:30.511030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:30.519397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-552fdf04-a900-4c81-8787-650f49cbe761 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145327 May 10 20:40:30.519972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 954/1606] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:30 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:30.524697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:30.525093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:30.531110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:30.531561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:30.532333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:30.532770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:30.594816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:30.602028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35a1a06e-eb7a-4da3-8a50-1296e8a6b16f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081125 May 10 20:40:30.602614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 955/1607] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:30 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:31.537015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:31.537656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:31.543885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:31.544326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:31.545093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:31.545521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:31.669896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:31.677646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5314602c-bbe0-4160-a6db-48c4470fdd36 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144651 May 10 20:40:31.678298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 956/1608] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:31.682980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:31.684081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:31.689471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:31.689914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:31.690714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:31.691147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:31.749797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:31.756913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-caed1d7b-89b9-4404-b004-7a3e22d005a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077699 May 10 20:40:31.757571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 957/1609] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:32.695370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:32.696045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:32.702498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:32.702951 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:32.703723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:32.704205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:32.833087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:32.840954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5419568e-9048-4cca-8fdc-343f063b8133 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149424 May 10 20:40:32.841561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 958/1610] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:32.845945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:32.846592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:32.852003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:32.852457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:32.853216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:32.853654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:32.912436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:32.920327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c224de7-8e52-4808-89ce-cebfb0b7ead1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077793 May 10 20:40:32.920902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 959/1611] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:33.858465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:33.859103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:33.865334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:33.865780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:33.866586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:33.867044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:33.992255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:34.000020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8f994e76-c0e3-4b4f-8e13-06baaee67558 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146092 May 10 20:40:34.000596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 960/1612] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:34.005023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:34.005657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:34.011120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:34.011572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:34.012344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:34.012805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:34.077374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:34.084771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6d7a0368-a79c-4fdf-bd10-c0c3065780a5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083248 May 10 20:40:34.085336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 961/1613] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:35.017479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:35.018195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:35.024403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:35.027999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:35.027999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:35.027999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:35.151864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:35.160349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a988fda-b75a-4164-9f3c-fec0a48d6a10 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146830 May 10 20:40:35.160908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 962/1614] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:35.165340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:35.165938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:35.171829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:35.172410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:35.173208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:35.173672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:35.232789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:35.239952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0b9c0249-76d7-4369-bbf1-092803bf9e2b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078123 May 10 20:40:35.240507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 963/1615] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:36.178228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:36.178883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:36.185477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:36.185927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:36.186733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:36.187175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:36.320135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:36.328372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9f36943d-6c68-445c-a16c-4001f474b0b5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154024 May 10 20:40:36.328943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 964/1616] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:36.336227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:36.336227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:36.339641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:36.340121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:36.341514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:36.341954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:36.400739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:36.408618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-59152d73-94e1-40d5-bb3f-90350d5a8941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078740 May 10 20:40:36.409186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 965/1617] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:37.345685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:37.346416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:37.352670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:37.353123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:37.353892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:37.354361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:37.480937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:37.489181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-abdb6d39-adc8-4707-8ec5-4882dfb9ead2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147355 May 10 20:40:37.489746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 966/1618] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:37 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:37.494035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:37.494658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:37.500069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:37.500517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:37.501281 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:37.501717 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:37.563745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:37.570970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6939420b-51cb-48d1-97c6-4a3e87d6931b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080274 May 10 20:40:37.571539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 967/1619] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:38.506176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:38.506828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:38.513774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:38.514257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:38.515028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:38.515470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:38.645964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:38.657236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d526f6a-05a2-4df1-ba56-6189d610b839 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.154628 May 10 20:40:38.658327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 968/1620] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:38.664694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:38.665312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:38.671779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:38.672238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:38.673024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:38.673465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:38.734799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:38.742424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d711490-d7d6-4458-9bd0-a1505e524a93 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082674 May 10 20:40:38.742991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 969/1621] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:39.675497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:39.676190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:39.687499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:39.688112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:39.689334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:39.689769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:39.823078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:39.830862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e6c71d10-2d42-4be6-a491-a83aef13dade tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.159277 May 10 20:40:39.831439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 970/1622] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:39.835761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:39.836367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:39.842220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:39.842670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:39.843439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:39.843883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:39.901748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:39.909453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b536fb28-8910-42b9-aec1-5feace1840f8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077088 May 10 20:40:39.910017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 971/1623] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:40.848343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:40.848987 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:40.855168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:40.855624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:40.856899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:40.857334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:40.982147 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:40.989809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bb0589e3-a718-46da-8a33-9bb948d6037b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145767 May 10 20:40:40.990482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 972/1624] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:40.994963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:40.995565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:41.001582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:41.002029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:41.002832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:41.003274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:41.065323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:41.072704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9d0f5bc0-52f2-4286-8559-cca23baa5bd8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081293 May 10 20:40:41.073264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 973/1625] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:42.007443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:42.008150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:42.014431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:42.014880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:42.015657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:42.016103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:42.140937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:42.148617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-005301e2-6257-48f4-9430-0f98aa33e879 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145071 May 10 20:40:42.149188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 974/1626] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:42.154037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:42.154674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:42.160026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:42.160476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:42.161246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:42.161689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:42.220940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:42.228238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88e4385d-7000-402c-96b5-0169cdb1e722 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078118 May 10 20:40:42.228806 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 975/1627] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:43.165817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:43.166467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:43.173370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:43.173819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:43.174624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:43.175062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:43.306964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:43.315464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-017e3ae4-6f75-4f0f-b1cc-3ac7ff4f6ff6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.153500 May 10 20:40:43.316047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 976/1628] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:43.320371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:43.320996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:43.326416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:43.326872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:43.327652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:43.328093 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:43.388779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:43.396197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9aa9b9e2-1aa9-4a69-9298-2054903d92be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079228 May 10 20:40:43.396761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 977/1629] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:44.332628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:44.333315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:44.339768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:44.340352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:44.341136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:44.341578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:44.468802 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:44.476614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5ce3b94c-f00f-4bbc-b7fb-6ea15221dd14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147903 May 10 20:40:44.477262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 978/1630] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:44.481593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:44.482227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:44.487573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:44.488026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:44.488820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:44.489242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:44.552318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:44.560441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8a63353a-f554-492b-a0b0-e6123f3de01e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082249 May 10 20:40:44.561011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 979/1631] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:44 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:45.492725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:45.493377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:45.499740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:45.500193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:45.500962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:45.501404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:45.626112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:45.633883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc19e402-963d-4096-be74-1c83a9a4c3e1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145061 May 10 20:40:45.634481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 980/1632] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:45.639309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:45.639915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:45.645284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:45.645736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:45.646543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:45.646985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:45.706594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:45.713961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b003969f-c0bd-49bb-bb3d-1b1f8a7f2bb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078545 May 10 20:40:45.714560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 981/1633] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:46.651367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:46.652019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:46.658917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:46.659374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:46.660145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:46.660585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:46.791467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:46.799742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-22fbcdc2-15c0-448a-a6cd-64681cc5b799 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.152270 May 10 20:40:46.800335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 982/1634] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:46 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:46.804898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:46.805534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:46.810910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:46.811363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:46.812128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:46.812566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:46.871348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:46.878510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3663204-c651-4018-9c68-f1c2f2828318 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077217 May 10 20:40:46.879074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 983/1635] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:46 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:47.817254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:47.817900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:47.824224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:47.824683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:47.825458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:47.825902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:47.949930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:47.957606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2bc6b9e7-e7f7-4c57-985a-29c782d57cf1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.144337 May 10 20:40:47.958200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 984/1636] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:47 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:47.962544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:47.963154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:47.968985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:47.969467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:47.970271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:47.970712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:48.035054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:48.046517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a129a1bf-dc76-48ae-83b9-d23853cb1978 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.087122 May 10 20:40:48.047358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 985/1637] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:48.975276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:48.975967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:48.982476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:48.982924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:48.983694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:48.984131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:49.110504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:49.118364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a2410a4-bfb9-4f28-a1ea-b7044dadf5b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.146900 May 10 20:40:49.118934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 986/1638] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:49.123859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:49.124469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:49.129847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:49.130334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:49.131112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:49.131554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:49.191116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:49.198462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80df0247-149d-4843-8d45-2c052a59dbdb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078564 May 10 20:40:49.199031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 987/1639] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:50.135788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:50.136482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:50.142805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:50.143255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:50.144023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:50.144461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:50.272369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:50.280613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a9e5c913-e5d7-4482-8e18-e2f11b69640e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.148673 May 10 20:40:50.281185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 988/1640] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:50.285521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:50.286148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:50.291602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:50.292054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:50.292825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:50.293917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:50.352136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:50.359941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a068c0d-2581-4329-9ed2-4f30ce9e18c5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077820 May 10 20:40:50.360513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 989/1641] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:51.298126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:51.298797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:51.305339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:51.305791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:51.306596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:51.307039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:51.432070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:51.439894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-001e4786-9abc-4e0d-9236-de07a962c863 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145773 May 10 20:40:51.440458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 990/1642] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:51 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:51.444779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:51.445388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:51.451404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:51.451865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:51.452636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:51.453078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:51.515163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:51.522433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82368e68-bb3d-49df-bc44-4fbff754ac7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081014 May 10 20:40:51.523002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 991/1643] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:52.456813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:52.457437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:52.463805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:52.464260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:52.465615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:52.466056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:52.592713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:52.600481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa638e68-2e84-45bc-8d1a-b62ad5544e89 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147599 May 10 20:40:52.601054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 992/1644] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:52.605361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:52.605964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:52.611401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:52.611846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:52.612615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:52.613049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:52.674220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:52.681807 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e437d6e0-7219-4dd3-bea0-9adcfcac1acc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079827 May 10 20:40:52.682439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 993/1645] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:53.616703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:53.617404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:53.623825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:53.624284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:53.625069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:53.625510 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:53.795835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:53.803626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a9b1b5c-354e-42ea-a08a-e96be2f72417 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.190799 May 10 20:40:53.804193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 994/1646] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:53.808797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:53.809405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:53.814871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:53.815319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:53.816089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:53.816528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:53.876036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:53.883367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c6a1d07-583d-450d-a144-af54d43e57e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077981 May 10 20:40:53.883931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 995/1647] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:53 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:54.821690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:54.822383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:54.829258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:54.829715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:54.830519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:54.830960 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:54.957746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:54.965502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a36eeab0-b5f6-48a4-9639-f0a52e02b936 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147792 May 10 20:40:54.966076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 996/1648] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:54 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:54.970393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:54.971001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:54.976396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:54.976845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:54.977632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:54.978055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:55.037628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:55.045184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cdd166a-5a7a-4f6b-9b6a-aa1561b7fdce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078164 May 10 20:40:55.045761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 997/1649] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:55.982660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:55.983295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:55.989107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:55.989551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:55.990333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:55.990767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:56.122810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:56.130541 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b469d8a5-e74b-436c-8b80-16f8ef77a5e3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.151858 May 10 20:40:56.131139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 998/1650] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:56.135407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:56.136014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:56.141916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:56.142393 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:56.143156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:56.143597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:56.205736 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:56.213071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-18fea6e1-0062-4945-afa3-5224b351680d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081031 May 10 20:40:56.213636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 999/1651] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:56 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:57.148081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:57.148704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:57.155290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:57.155777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:57.156555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:57.156992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:57.284001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:57.291921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-03837ae2-6e9d-45b0-8646-7fc89705dfda tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.147751 May 10 20:40:57.292496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1000/1652] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:57 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:57.297961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:57.298611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:57.304809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:57.305257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:57.306021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:57.306479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:57.366204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:57.374045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35468615-90d1-4be9-acbf-39834e42b4f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080630 May 10 20:40:57.374632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1001/1653] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:57 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:58.309753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:58.310501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:58.316745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:58.317192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:58.317956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:58.318413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:58.446466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:58.454297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-382bc606-3069-4f82-ace3-424e75f841c2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.149090 May 10 20:40:58.454852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1002/1654] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:58 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:58.459427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:58.460029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:58.466253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:58.466699 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:58.467461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:58.467896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:58.525790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:58.534527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3dc51f37-8c4f-421f-8bb4-51a3e06e7480 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078513 May 10 20:40:58.535091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1003/1655] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:40:59.471404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:59.472010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:59.478323 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:59.478766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:59.479523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:59.479952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:59.604820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:59.613084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a38ce406-3ccd-414e-ac93-86cf82b855ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.145507 May 10 20:40:59.613645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1004/1656] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:40:59.617998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:40:59.618694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:40:59.624805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:59.625260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:59.626036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:40:59.626507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:40:59.688356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:40:59.695618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f93dec72-2dce-4314-8a11-3ce4ea731d29 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081000 May 10 20:40:59.696196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1005/1657] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:40:59 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:00.630763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:00.631438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:00.637918 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:00.638412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:00.639187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:00.639628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:00.776090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:00.784406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-582cec86-244e-44e3-b3ad-584918b25658 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1559 microversion: 2.1 time: 0.157616 May 10 20:41:00.784983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1006/1658] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:00 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:00.797888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:00.798660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:00.804839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:00.805295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:00.806104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:00.806542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:00.888275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:00.895598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2b517985-f3da-4b63-a749-f2c27cb1b3fb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.109680 May 10 20:41:00.896177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1007/1659] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:01.326049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-00286d04-fb69-4881-9a8e-0012d6170315 req-4fb77d26-a327-4a9e-b3de-1a46479ad76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb90d6b-7083-4118-94fa-736fbc886744", "name": "network-vif-deleted", "tag": "1b69dc72-245c-49f9-855f-4cf1a1b1b094"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:41:01.333975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-00286d04-fb69-4881-9a8e-0012d6170315 req-4fb77d26-a327-4a9e-b3de-1a46479ad76d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:01.338970 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-00286d04-fb69-4881-9a8e-0012d6170315 req-4fb77d26-a327-4a9e-b3de-1a46479ad76d service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:01.346097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-00286d04-fb69-4881-9a8e-0012d6170315 req-4fb77d26-a327-4a9e-b3de-1a46479ad76d service nova] Creating event network-vif-deleted:1b69dc72-245c-49f9-855f-4cf1a1b1b094 for instance 9bb90d6b-7083-4118-94fa-736fbc886744 on hv-cinder-82880 May 10 20:41:01.351339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-00286d04-fb69-4881-9a8e-0012d6170315 req-4fb77d26-a327-4a9e-b3de-1a46479ad76d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029540 May 10 20:41:01.351979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1008/1660] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:41:01.802758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:01.803461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:01.810342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:01.810786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:01.811548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:01.811979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:01.873204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:01.880876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af4498ac-e252-4bdc-8624-36fe0b9de4f7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082862 May 10 20:41:01.881437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1009/1661] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:01 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:01.912031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:01.912636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:01.918707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:01.919145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:01.919931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:01.920390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:01.978278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:01.985880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a62072d-2f51-4f8d-b242-29ac1d8dc52e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077341 May 10 20:41:01.986474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1010/1662] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:02.903042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:02.903042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:02.905299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:02.905751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:02.906565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:02.907013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:02.972895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:02.980833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a502d148-6e9f-40d0-beda-d15b24cb3b69 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.087062 May 10 20:41:02.981547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1011/1663] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:03.002739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:03.003350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:03.009029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:03.009481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:03.010283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:03.010719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:03.070470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:03.088170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7e971296-c13c-40f8-b48c-09a2023da45f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079648 May 10 20:41:03.088750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1012/1664] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:02 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:03.997423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:04.000369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:04.004754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:04.005209 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:04.005985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:04.006457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:04.066464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:04.074735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5131890a-e667-4931-8a9b-668939a0dad7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081256 May 10 20:41:04.075319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1013/1665] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:04.104661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:04.105290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:04.111003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:04.111448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:04.112216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:04.112647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:04.171912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:04.179583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab349b91-0d1b-4948-8428-aa180169b743 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078655 May 10 20:41:04.180148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1014/1666] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:05.094870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:05.095590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:05.101851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:05.102342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:05.103120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:05.103562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:05.162993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:05.171605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-069b0d2d-416c-49b0-b76f-81e8a63f0b38 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080687 May 10 20:41:05.172172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1015/1667] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:05.203388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:05.203996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:05.209667 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:05.210131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:05.210898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:05.211331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:05.269937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:05.277890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4dca8632-5354-4fb8-bdbe-3293d959b388 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078114 May 10 20:41:05.278469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1016/1668] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:06.188089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:06.188785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:06.195168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:06.195628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:06.196404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:06.196843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:06.259154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:06.267116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3b2cb912-fa44-4e0a-a5d6-e0f96a7ab8d8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082935 May 10 20:41:06.267696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1017/1669] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:06.294852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:06.295470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:06.301252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:06.301705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:06.302592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:06.303028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:06.362142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:06.369314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d65a2ab3-42fa-489c-bda9-7ae9e8f65c87 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078741 May 10 20:41:06.369879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1018/1670] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:06 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:07.283657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:07.284333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:07.290846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:07.291296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:07.292065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:07.292528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:07.353716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:07.361356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9a22bbf-9106-4941-893a-8482e3ebd5bc tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081582 May 10 20:41:07.361919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1019/1671] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:07 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:07.385342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:07.385944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:07.391937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:07.392386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:07.393152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:07.393585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:07.453775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:07.466117 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a68e7ada-a866-4f44-9bee-3923bd7673ed tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084170 May 10 20:41:07.466682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1020/1672] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:07 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:08.378170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:08.378808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:08.385032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:08.385483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:08.386878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:08.387318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:08.446839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:08.455401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd03479e-eaf0-4247-b873-d2f4632e4c6a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081188 May 10 20:41:08.455973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1021/1673] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:08 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:08.481841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:08.482475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:08.488121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:08.488579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:08.489354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:08.489887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:08.550792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:08.558971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d5d2c5d0-2477-4c3b-81bf-4607943b08a6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080708 May 10 20:41:08.559571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1022/1674] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:09.472214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:09.472832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:09.479269 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:09.479718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:09.480485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:09.480926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:09.540624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:09.548364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d841f44c-29ea-4d6c-871d-28ad49505926 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080054 May 10 20:41:09.548929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1023/1675] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:09.575748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:09.576356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:09.581911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:09.582398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:09.583163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:09.583597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:09.642325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:09.649489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0eb63496-29f7-493f-abdc-751698e67132 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077903 May 10 20:41:09.650053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1024/1676] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:09 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:10.565028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:10.565651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:10.571956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:10.572409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:10.573181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:10.574285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:10.634317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:10.642582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c8e426ed-d90b-43c7-af94-0842599fa448 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081488 May 10 20:41:10.643153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1025/1677] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:10.666152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:10.666768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:10.672440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:10.672889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:10.673666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:10.674125 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:10.732969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:10.740240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88f52cab-0fac-48ff-984e-95d8e954355b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077557 May 10 20:41:10.740928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1026/1678] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:11.659604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:11.660250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:11.666566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:11.667026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:11.667919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:11.668360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:11.732270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:11.739991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43cd655e-d2d5-468f-8159-14d809d32e4f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084319 May 10 20:41:11.740565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1027/1679] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:11.758851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:11.759471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:11.765966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:11.766452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:11.767229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:11.767679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:11.827010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:11.834194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f48c2402-3b78-41d4-981e-c878427390b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079682 May 10 20:41:11.834762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1028/1680] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:11 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:12.762049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:12.762771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:12.768935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:12.769388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:12.770188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:12.770631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:12.841821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:12.849539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-852a02d0-72a6-416a-939a-0046d25a398c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.091461 May 10 20:41:12.850128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1029/1681] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:12 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:12.854451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:12.855632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:12.861099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:12.861554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:12.862352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:12.862793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:12.920971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:12.928101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a21676e6-8236-4fca-8939-2e305c0e6a3e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077010 May 10 20:41:12.928941 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1030/1682] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:13.866128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:13.866838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:13.873636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:13.874101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:13.874868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:13.875306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:13.939267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:13.949096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-83ce27a4-f3c0-44b9-8bd7-29bb74bc8b4a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.086871 May 10 20:41:13.949722 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1031/1683] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:13.954613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:13.955316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:13.961528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:13.961985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:13.962823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:13.963278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:14.024543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:14.032858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ca6d5f9-e2e2-4ae6-8498-df8f3cd6fcc4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081993 May 10 20:41:14.033437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1032/1684] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:13 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:14.966763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:14.967440 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:14.973593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:14.974037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:14.974824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:14.975255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:15.035016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:15.043324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ea2234b6-aec8-45b8-88d7-6e140f9093b3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080946 May 10 20:41:15.043898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1033/1685] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:15.049866 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:15.056832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:15.056832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:15.056832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:15.057610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:15.058049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:15.117472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:15.124889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d83e9841-8863-4c6a-8807-cd11fd69ef3f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078651 May 10 20:41:15.125463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1034/1686] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:16.061672 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:16.062417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:16.068776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:16.069225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:16.070006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:16.070477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:16.143113 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:16.151005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dbe7cc64-7254-4a7d-a00e-c2c913bfd3f2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.093771 May 10 20:41:16.151569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1035/1687] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:16.156078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:16.156683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:16.162231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:16.162683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:16.163460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:16.163898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:16.223036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:16.230850 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c65ffae-e4c5-4b78-98a9-b04b54b27db8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078202 May 10 20:41:16.231417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1036/1688] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:17.168560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:17.169050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:17.175298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:17.175748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:17.176524 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:17.176966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:17.237588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:17.245417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d3a029f2-9219-4002-b2c6-3a043a92f0d5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081493 May 10 20:41:17.245985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1037/1689] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:17.250367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:17.251005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:17.256418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:17.256872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:17.257643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:17.258105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:17.316952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:17.324360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7719af8f-a9e3-404b-b99a-df098f195304 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077389 May 10 20:41:17.324927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1038/1690] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:17 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:18.262035 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:18.262729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:18.268921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:18.269363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:18.270142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:18.270576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:18.335530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:18.342895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c6715230-891d-403a-9deb-d66ada45c566 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084710 May 10 20:41:18.343461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1039/1691] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:18 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:18.347731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:18.348344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:18.353728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:18.354211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:18.355006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:18.355439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:18.414071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:18.421455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19e29242-311d-49cb-b003-c54299211727 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077059 May 10 20:41:18.422016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1040/1692] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:19.360380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:19.361046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:19.367306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:19.367748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:19.368511 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:19.368936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:19.428873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:19.437429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8e66a66-0c39-4bc6-a330-6e0b2e7dc884 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080854 May 10 20:41:19.438032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1041/1693] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:19 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:19.442439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:19.443043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:19.448727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:19.449171 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:19.449927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:19.450390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:19.509829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:19.516989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-078e3c3b-ef6f-4683-b125-29b287fd294b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077992 May 10 20:41:19.517557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1042/1694] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:20.453812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:20.454462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:20.460784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:20.461235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:20.462013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:20.462478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:20.525660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:20.533767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1725a75b-62a1-4802-a557-663e11669901 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083827 May 10 20:41:20.534383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1043/1695] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:20.538770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:20.539379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:20.544782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:20.545237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:20.546005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:20.546470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:20.606342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:20.613557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3f6d7dbe-44ec-4be8-83e3-06e6e01d3937 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078239 May 10 20:41:20.614145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1044/1696] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:21.549648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:21.550327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:21.556907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:21.557354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:21.558139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:21.558579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:21.618177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:21.625905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dbd5ef75-3486-4f35-9b89-44f3fdefa5bf tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080148 May 10 20:41:21.626512 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1045/1697] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:21.630955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:21.631557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:21.637535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:21.637984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:21.638776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:21.639234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:21.697305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:21.704996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e176fae5-9b55-4e51-b11a-fd2a1066a6b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077562 May 10 20:41:21.705563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1046/1698] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:21 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:22.642509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:22.643169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:22.649451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:22.649903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:22.650701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:22.651656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:22.714614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:22.722789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-982a4eda-27c8-49ef-bb3a-1240530e9689 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084185 May 10 20:41:22.723364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1047/1699] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:22 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:22.728052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:22.728662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:22.734895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:22.735346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:22.736115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:22.736561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:22.796272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:22.804346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a0ee3f4-292b-40fe-a97e-2e906f6897b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079901 May 10 20:41:22.804942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1048/1700] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:23.740446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:23.741123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:23.748204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:23.750969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:23.750969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:23.750969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:23.810123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:23.817879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa7ee18b-5134-4322-b680-9dd2d568008d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081456 May 10 20:41:23.818481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1049/1701] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:23 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:23.828221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:23.828833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:23.834449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:23.834896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:23.835657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:23.836105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:23.894655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:23.901917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19214ac6-2550-4a9f-a55e-1b2c844830e3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077249 May 10 20:41:23.902522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1050/1702] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:24.834567 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:24.835200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:24.841904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:24.842377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:24.843138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:24.843569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:24.909639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:24.918334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bd91d0c2-c0aa-4dd8-a3b5-e0e63f3e77eb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.087690 May 10 20:41:24.918907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1051/1703] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:24.923263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:24.923865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:24.929508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:24.929963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:24.930759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:24.931199 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:24.989368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:24.996670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad02ec4b-7a5a-4d1b-83fa-c0572140a891 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.076815 May 10 20:41:24.997236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1052/1704] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:25.935700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:25.936363 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:25.942112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:25.942578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:25.943332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:25.943761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:26.002712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:26.010356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d770bcfd-ea38-45ae-b91c-661a8eb192ba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079192 May 10 20:41:26.020099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1053/1705] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:25 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:26.020099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:26.020099 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:26.021280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:26.021725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:26.022515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:26.022947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:26.081929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:26.089225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-446d8b4c-196f-458e-8da7-36c8fea71db4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077395 May 10 20:41:26.089790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1054/1706] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:27.027666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:27.028338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:27.034629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:27.035082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:27.035855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:27.036292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:27.099151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:27.107875 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bd770bbf-6cf1-4576-a7c5-7b9e5ca7f192 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084519 May 10 20:41:27.108468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1055/1707] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:27 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:27.113225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:27.113847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:27.119820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:27.120278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:27.121051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:27.121494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:27.180669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:27.188017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f8d5bd94-8b6e-426f-9805-f4dc16264021 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078603 May 10 20:41:27.188766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1056/1708] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:28.125852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:28.126592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:28.132961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:28.133414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:28.134220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:28.134659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:28.194870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:28.204354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cca07ecd-5f43-4e50-8fc5-2b366293c555 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082353 May 10 20:41:28.204999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1057/1709] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:28.209518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:28.210139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:28.216347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:28.216789 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:28.217547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:28.217978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:28.276662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:28.283835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-97a93761-cde8-472d-8494-0d138e6b3b15 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077916 May 10 20:41:28.284403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1058/1710] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:29.221892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:29.222592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:29.229901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:29.230566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:29.231728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:29.232470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:29.296739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:29.304829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-11aa3b2c-6f9a-42e0-ad5b-9802070bbd3e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.086800 May 10 20:41:29.305390 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1059/1711] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:29.309659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:29.310286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:29.315636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:29.316086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:29.316847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:29.317289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:29.376771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:29.384024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6afa8eaf-9d2a-4250-a49e-68d3c4c68495 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077716 May 10 20:41:29.384594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1060/1712] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:30.321430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:30.322139 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:30.328932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:30.329373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:30.330170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:30.330603 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:30.389947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:30.397623 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9d6a52a3-b889-45ba-aaa2-77b650a90385 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080039 May 10 20:41:30.398217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1061/1713] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:30 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:30.402540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:30.403146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:30.408784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:30.409238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:30.410005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:30.410467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:30.469534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:30.476677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e55998fa-1358-4c7a-98f5-45157e94b0e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077535 May 10 20:41:30.477240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1062/1714] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:30 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:31.414018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:31.414697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:31.421088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:31.421538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:31.422339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:31.422772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:31.485676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:31.493383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d0fdbbda-572c-42ae-ae4a-2274e00a0fd0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083328 May 10 20:41:31.493939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1063/1715] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:31.498770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:31.499370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:31.504743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:31.505185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:31.505942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:31.506399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:31.812598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:31.819993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-92612dc4-067e-41c8-9529-a0c47c0baea8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.324565 May 10 20:41:31.820569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1064/1716] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:32.511252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:32.511872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:32.518319 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:32.518771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:32.519538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:32.519972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:32.579690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:32.587303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6b69861f-aac8-469f-90ad-413286633ce9 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080456 May 10 20:41:32.587870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1065/1717] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:32.837121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:32.837654 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:32.843572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:32.844023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:32.844795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:32.845234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:32.905357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:32.913613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f2f8eab1-e064-418a-8e37-8db60c65df05 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080569 May 10 20:41:32.914212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1066/1718] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:33.604239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:33.604917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:33.613739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:33.614457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:33.615636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:33.616301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:33.691442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:33.699922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c0d3ef6-8848-4fe9-a565-510ec506b437 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.099550 May 10 20:41:33.700560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1067/1719] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:33.931590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:33.932720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:33.938517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:33.939012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:33.939720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:33.940151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:34.016650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:34.024065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e724a23-306b-4c09-a837-a24f4a7cad94 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.096496 May 10 20:41:34.026275 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1068/1720] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:34.717389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:34.718002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:34.724311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:34.724762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:34.725536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:34.725977 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:34.785126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:34.793450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bdf64946-1d33-4c65-861e-0bb823eb55cb tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080631 May 10 20:41:34.794020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1069/1721] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:34 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:35.041298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:35.041836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:35.047674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:35.048121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:35.048892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:35.049332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:35.108642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:35.116038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35822755-2271-415d-b9aa-613a24f1e4c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078833 May 10 20:41:35.121092 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1070/1722] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:35.810869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:35.811534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:35.817681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:35.818149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:35.818904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:35.819335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:35.879206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:35.887001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ce67245c-0227-4d48-a246-b7312704fc0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080707 May 10 20:41:35.887571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1071/1723] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:36.133662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:36.134230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:36.140657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:36.141102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:36.141862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:36.142322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:36.201879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:36.209284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-62b5d909-6a8f-4b29-ab34-a673297ecfac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079541 May 10 20:41:36.209863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1072/1724] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:36.904273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:36.904917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:36.911333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:36.911815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:36.912618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:36.913056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:36.980456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:36.988207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d1e65611-1ecf-4cfc-bd0b-168f3784a91b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.088251 May 10 20:41:36.988782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1073/1725] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:37.225938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:37.226591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:37.232570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:37.233026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:37.233799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:37.234273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:37.293226 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:37.300518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a734f2f-fafa-4c95-bc02-c2f04b14c739 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078373 May 10 20:41:37.301089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1074/1726] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:38.005504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:38.006231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:38.012568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:38.013011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:38.013772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:38.014225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:38.075173 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:38.083145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-12f88ecd-8f48-43c5-bf9d-05b6ef97d408 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081452 May 10 20:41:38.083732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1075/1727] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:38.317853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:38.318395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:38.324663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:38.325120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:38.325889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:38.326348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:38.386168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:38.393338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7bb1cb5a-3dcf-4cc6-939c-b602fbbb6d1b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079497 May 10 20:41:38.393898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1076/1728] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:39.100155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:39.100845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:39.107078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:39.107526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:39.108327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:39.108769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:39.171871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:39.180418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cf75d15e-afa5-46ec-b6d4-1fa8cf941f99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083846 May 10 20:41:39.183181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1077/1729] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:39.410190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:39.410718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:39.416771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:39.417215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:39.417975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:39.418441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:39.478703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:39.485943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-783d9584-46ea-47e6-af09-8a478ecb3b3b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079692 May 10 20:41:39.486549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1078/1730] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:40.198175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:40.198878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:40.205105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:40.205549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:40.206338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:40.206769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:40.266535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:40.274073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e277ebfd-4eed-4a7a-9361-d9c8798cb16d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080277 May 10 20:41:40.274658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1079/1731] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:40.502507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:40.503062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:40.509018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:40.509461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:40.510966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:40.511400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:40.569997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:40.577950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-06e63313-4d86-4699-baea-0f5d93c8aeb8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079249 May 10 20:41:40.578549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1080/1732] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:41.290539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:41.291905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:41.298096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:41.298563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:41.299328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:41.299787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:41.363633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:41.371429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1e6d20a1-be3b-4981-a928-3dd64ec54c14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084761 May 10 20:41:41.371993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1081/1733] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:41.594589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:41.595207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:41.601111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:41.601561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:41.602349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:41.602787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:41.670581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:41.678217 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-380ff273-c7d0-4fdb-a2dc-e4fd63b132f3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.087132 May 10 20:41:41.678795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1082/1734] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:42.388138 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:42.388804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:42.395197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:42.395641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:42.396396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:42.396827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:42.457800 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:42.465509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7eb1c250-9cdd-44ae-a6e5-c8f11123225d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081232 May 10 20:41:42.466071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1083/1735] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:42.695144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:42.695764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:42.701686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:42.702165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:42.702937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:42.703374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:42.763058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:42.770315 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aeca4949-c761-43e3-8774-6a67d24038db tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079025 May 10 20:41:42.770887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1084/1736] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:43.482287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:43.482844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:43.489148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:43.489600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:43.490395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:43.490834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:43.553059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:43.561260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cef42697-b369-4b5d-98bb-0060377dd332 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082900 May 10 20:41:43.561835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1085/1737] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:43.787608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:43.788143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:43.794027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:43.794507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:43.795274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:43.795721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:43.855577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:43.862835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0085dc23-6152-4e37-82c0-f3d0069ce3aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079179 May 10 20:41:43.863405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1086/1738] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:44.578536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:44.579161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:44.585422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:44.585878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:44.586677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:44.587122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:44.655067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:44.666592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d79b0eb3-e0d5-46f6-b47d-5ee467a3c166 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.091833 May 10 20:41:44.667207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1087/1739] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:44.880208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:44.880747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:44.887232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:44.887683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:44.888451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:44.888892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:44.951614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:44.958913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fa8ac9d9-bcc1-439d-b312-7c31044a8a8c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082619 May 10 20:41:44.959489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1088/1740] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:44 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:45.684839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:45.685482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:45.691770 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:45.692218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:45.692981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:45.693424 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:45.755775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:45.763498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e7aa1ab0-b96a-429b-bc6c-f617f15f9756 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083215 May 10 20:41:45.764063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1089/1741] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:45.976112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:45.976648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:45.983444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:45.983889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:45.984643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:45.985076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:46.043470 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:46.050546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ed5d0b11-fb70-40b6-951e-5bf7c004abd4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078315 May 10 20:41:46.051108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1090/1742] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:46.780242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:46.780917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:46.787358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:46.787803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:46.788560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:46.788994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:46.850828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:46.859015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-25895381-5a5d-4830-a670-e2ec5dec4c47 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082682 May 10 20:41:46.859573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1091/1743] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:46 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:47.067177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:47.067738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:47.073575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:47.074029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:47.074813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:47.075246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:47.134069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:47.141758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ef111a7-e08e-4c70-b279-49d5ae62c044 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078418 May 10 20:41:47.142371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1092/1744] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:47.875797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:47.876443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:47.882948 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:47.883396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:47.884154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:47.885122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:47.947394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:47.954983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a4ca6171-a7f1-469e-9ab6-dec85871aa32 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083141 May 10 20:41:47.955555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1093/1745] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:47 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:48.158203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:48.158740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:48.164679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:48.165121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:48.166564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:48.166994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:48.225845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:48.233808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3550c9fe-e501-4394-87b0-7f60b455e67d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079412 May 10 20:41:48.234421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1094/1746] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:48 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:48.972322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:48.973019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:48.979881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:48.980334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:48.981105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:48.981548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:49.053629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:49.061796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b012f09d-5fb3-44dd-b7b5-abb5bdd45cb3 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.093356 May 10 20:41:49.062401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1095/1747] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:49.250891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:49.251438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:49.257423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:49.257879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:49.258703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:49.259146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:49.320134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:49.327448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e246b984-5dff-4b77-9927-b028f6c8b30e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080493 May 10 20:41:49.328026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1096/1748] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:50.079298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:50.079995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:50.086356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:50.086811 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:50.087658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:50.088098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:50.150397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:50.158142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-efaa8ff8-e4de-4aa0-aadf-d7a13c21b809 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082732 May 10 20:41:50.158715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1097/1749] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:50.344231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:50.344792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:50.350703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:50.351151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:50.351915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:50.352356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:50.411456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:50.419318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dcecc74d-a6be-4403-a5c9-a7c283c80081 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078922 May 10 20:41:50.419889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1098/1750] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:51.175468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:51.176159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:51.183227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:51.183679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:51.184446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:51.184880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:51.247947 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:51.255846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c329b508-ba5d-4ed4-93f3-32c27cf10d9f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084302 May 10 20:41:51.256418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1099/1751] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:51 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:51.436786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:51.437408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:51.443338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:51.443790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:51.444587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:51.445027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:51.503909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:51.511724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c5c7ae4-4436-4620-965d-674346cebf7c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078796 May 10 20:41:51.512296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1100/1752] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:52.272661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:52.273288 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:52.279690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:52.280143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:52.280909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:52.281347 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:52.344359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:52.351927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0775774-e425-42d4-af8d-fa23dbb32904 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083153 May 10 20:41:52.352494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1101/1753] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:52.528848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:52.529432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:52.535293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:52.535743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:52.536508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:52.536942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:52.596383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:52.604161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-134ef1be-3e97-4af1-83f4-d6a0f7c671f7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079723 May 10 20:41:52.604725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1102/1754] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:53.369815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:53.370489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:53.376729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:53.377177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:53.377946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:53.378409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:53.448959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:53.456664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db48c071-eb60-469f-9855-03b1ed26187f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.091277 May 10 20:41:53.457433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1103/1755] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:53.621230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:53.621845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:53.627737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:53.628189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:53.628965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:53.629403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:53.721189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:53.730972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58faa40b-82f9-4bef-8d07-24ec480225be tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.114107 May 10 20:41:53.731698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1104/1756] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:53 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:54.472998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:54.473635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:54.480132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:54.480625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:54.481394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:54.481830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:54.546795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:54.554898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aeaffb5b-ce90-4fc8-a5d7-c861d2cdca72 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.085975 May 10 20:41:54.555478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1105/1757] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:54 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:54.748599 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:54.749282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:54.755140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:54.755596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:54.756365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:54.756810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:54.818302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:54.826238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-13ee753b-ef19-44f8-9478-9218a52a756a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081437 May 10 20:41:54.826808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1106/1758] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:55.571902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:55.572488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:55.578785 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:55.579237 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:55.580011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:55.580449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:55.639913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:55.647634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-be5ae747-4ab0-402a-a641-3312bc32a29d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079734 May 10 20:41:55.648206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1107/1759] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:55.843718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:55.847826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:55.850443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:55.850893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:55.851845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:55.852291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:55.912950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:55.920387 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-59f9934f-4624-459f-b8ad-712412b76163 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080821 May 10 20:41:55.921143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1108/1760] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:55 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:56.665877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:56.666578 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:56.672401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:56.672839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:56.673598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:56.674029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:56.733928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:56.741509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85d115d3-aba5-4502-8d82-358fa5f8169a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080362 May 10 20:41:56.742068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1109/1761] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:56 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:56.937555 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:56.938196 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:56.944414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:56.944864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:56.945661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:56.946114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:57.005919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:57.013734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-08c7aec9-8a2c-4ad1-a3ca-a16c2f40bcb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080001 May 10 20:41:57.014328 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1110/1762] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:56 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:57.758542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:57.759213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:57.765067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:57.765518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:57.766322 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:57.766768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:57.828618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:57.836333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e431f90-c85b-405c-966c-3aab22cf396c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081705 May 10 20:41:57.837419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1111/1763] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:57 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:58.030839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:58.031366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:58.037616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:58.038034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:58.038837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:58.039274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:58.100556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:58.107690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec8f3fcb-9a95-4528-9c0b-8995939a9d5d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080762 May 10 20:41:58.108262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1112/1764] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:58.853326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:58.853991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:58.859740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:58.860188 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:58.860950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:58.861391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:58.920306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:58.928229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f95e006e-e7b4-4d8b-bec3-402d8a5ef569 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079358 May 10 20:41:58.928795 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1113/1765] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:58 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:59.125038 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:59.125582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:59.131967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:59.134070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:59.134070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:59.134070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:59.193908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:41:59.201500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-90257915-d3df-4ca6-a106-5e9f2143835a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080359 May 10 20:41:59.202076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1114/1766] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:59 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:41:59.945352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:41:59.946021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:41:59.951894 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:59.952343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:41:59.953109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:41:59.953543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:00.013845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:00.021527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-44dc85cc-156c-4240-ac46-80f773cb2013 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080006 May 10 20:42:00.022107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1115/1767] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:41:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:00.218314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:00.218853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:00.225367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:00.225823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:00.226626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:00.227074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:00.286745 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:00.294650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-79e6dfd4-bea1-4de8-9a8d-ab1a468dbab3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080320 May 10 20:42:00.295224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1116/1768] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:01.038310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:01.038942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:01.044847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:01.045302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:01.046070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:01.046531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:01.120999 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:01.128884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2336b4b9-10f8-46dc-81cd-216e4a4e8d9b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.094429 May 10 20:42:01.129456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1117/1769] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:01 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:01.312311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:01.312857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:01.319189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:01.319639 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:01.320421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:01.320858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:01.380765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:01.388718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d047f4d-cf65-4b8f-a104-8900b809354c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080426 May 10 20:42:01.389291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1118/1770] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:02.144728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:02.145465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:02.151841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:02.152291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:02.153063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:02.153503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:02.213032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:02.220910 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-677c0c7c-9314-4c66-979d-fd181238b2ab tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080089 May 10 20:42:02.221480 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1119/1771] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:02 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:02.404622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:02.405182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:02.411439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:02.411903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:02.412670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:02.413114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:02.475111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:02.482721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-027edd18-0646-4541-b48b-1cd364658314 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081990 May 10 20:42:02.483302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1120/1772] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:02 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:03.237292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:03.237929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:03.244131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:03.244576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:03.245331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:03.245763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:03.306562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:03.314186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-644a70be-b961-46de-9c17-96b0611ae635 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080737 May 10 20:42:03.314746 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1121/1773] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:03 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:03.499543 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:03.500091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:03.506380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:03.506826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:03.507583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:03.508017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:03.567562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:03.574921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0f26871f-760e-4234-a6a2-3764266dffa0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079239 May 10 20:42:03.575516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1122/1774] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:03 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:04.331630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:04.332298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:04.339126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:04.339581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:04.340353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:04.340793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:04.410582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:04.418494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80a504ef-ddd1-445a-a482-02a1c90a634a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.090808 May 10 20:42:04.419071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1123/1775] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:04 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:04.591825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:04.592395 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:04.598700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:04.599148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:04.599915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:04.600351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:04.659659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:04.666842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-644ffd6b-218d-4c8a-a7d0-c1f293d5e244 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078944 May 10 20:42:04.667409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1124/1776] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:05.434842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:05.435457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:05.441367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:05.441808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:05.442642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:05.443023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:05.501669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:05.509211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e7e79fb5-7919-41a4-9e75-4a0c8dd5be81 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.078218 May 10 20:42:05.509776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1125/1777] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:05 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:05.683965 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:05.684569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:05.690718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:05.691162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:05.691920 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:05.692348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:05.752097 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:05.759428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-651ad03b-b605-445d-921f-6198a86ee79e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079769 May 10 20:42:05.760018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1126/1778] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:06.525793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:06.526487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:06.532325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:06.532774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:06.533537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:06.533973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:06.593663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:06.601368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-64d35a74-5ddb-4b77-9933-0829ee4673df tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079427 May 10 20:42:06.601930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1127/1779] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:06 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:06.776086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:06.776614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:06.783009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:06.783459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:06.784227 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:06.784662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:06.844404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:06.851617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-46e7757a-f18f-4490-bfd6-4e5cd1d1a8e4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079435 May 10 20:42:06.852215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1128/1780] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:06 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:07.618472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:07.619089 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:07.625195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:07.625647 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:07.626471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:07.626906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:07.689106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:07.696828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-32f54bb4-4140-4e5e-97b6-beb9485617e8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082256 May 10 20:42:07.697901 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1129/1781] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:07 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:07.868587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:07.869619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:07.876033 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:07.876488 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:07.877262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:07.877702 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:07.938396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:07.945630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d8839120-5077-45b7-b693-5b588f909840 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080884 May 10 20:42:07.946228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1130/1782] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:07 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:08.715292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:08.715920 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:08.723062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:08.723502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:08.724297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:08.724730 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:08.785634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:08.793973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ded1462b-0ef4-41a1-8aeb-d98dba54b38c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083168 May 10 20:42:08.794561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1131/1783] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:08 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:08.962635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:08.963849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:08.970195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:08.970588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:08.971357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:08.971792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:09.031535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:09.038869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-309efc36-95a1-4b16-9626-ecd70dd76054 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079922 May 10 20:42:09.039443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1132/1784] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:09.811127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:09.811775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:09.817628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:09.818071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:09.818851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:09.819284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:09.878547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:09.886696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a6c6bc8-0bc4-444d-9364-1f5cbfcde9b2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079538 May 10 20:42:09.887262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1133/1785] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:09 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:10.055252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:10.055856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:10.062568 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:10.062975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:10.063731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:10.064163 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:10.123404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:10.130768 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4813b99c-b198-4e74-b261-b6a6361c2f77 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079351 May 10 20:42:10.131337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1134/1786] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:10.904022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:10.904675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:10.910565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:10.911013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:10.911775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:10.912213 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:10.974049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:10.982435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3b30ae6e-8b37-40e8-9ea2-c0ae2146a5d2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082857 May 10 20:42:10.983003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1135/1787] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:10 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:11.147372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:11.147986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:11.154966 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:11.155361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:11.156123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:11.156560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:11.216879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:11.224241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c670d89-3566-4808-a369-2dd4da77f0ad tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080694 May 10 20:42:11.224803 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1136/1788] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:11 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:11.999750 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:12.000414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:12.006340 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:12.006790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:12.007552 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:12.007991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:12.077320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:12.090144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cb6cdfdd-711c-42b4-9433-fe93fd8f1729 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.094229 May 10 20:42:12.090719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1137/1789] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:11 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:12.240658 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:12.241273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:12.248238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:12.248687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:12.249448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:12.249953 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:12.309304 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:12.316538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8821764e-f8a6-4384-9324-dff057dc410d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079702 May 10 20:42:12.317102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1138/1790] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:13.107149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:13.107859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:13.113720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:13.114205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:13.114974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:13.115414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:13.191070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:13.199697 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0217311a-af01-4b6c-be92-f108c4ca5e0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.096319 May 10 20:42:13.200939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1139/1791] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:13 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:42:13.333670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:13.334327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:13.340721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:13.345540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:13.345540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:13.345540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:13.404212 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:13.411613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c8af2b7-951e-478c-a52b-895d94fdd1df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081774 May 10 20:42:13.412181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1140/1792] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:13 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:14.216166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:14.216842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:14.222732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:14.223185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:14.223962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:14.224401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:14.284386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:14.292185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-111997e8-9984-4d9e-9934-6e62279e09d1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080578 May 10 20:42:14.292752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1141/1793] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:14 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:14.428564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:14.429182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:14.435657 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:14.436110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:14.436881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:14.437325 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:14.496829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:14.504123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b85957a6-1d42-4ba4-ad5d-2ff2f3d85307 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079721 May 10 20:42:14.504719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1142/1794] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:14 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:15.309336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:15.309938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:15.315843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:15.316298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:15.317074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:15.317489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:15.379118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:15.387128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1e35fa37-7a50-43fa-9365-2382f3f34c99 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082262 May 10 20:42:15.387710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1143/1795] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:15 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:15.520891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:15.521436 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:15.528278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:15.528720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:15.529476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:15.529904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:15.589383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:15.596580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-30e95555-af8d-4060-8212-fb27e6526ff6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079757 May 10 20:42:15.597143 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1144/1796] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:16.404707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:16.405408 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:16.411475 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:16.411924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:16.412732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:16.413175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:16.479079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:16.486772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bfef3055-d117-4dda-82a2-2b4da3c84666 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.086514 May 10 20:42:16.487339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1145/1797] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:16 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:16.614609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:16.615235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:16.622277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:16.622978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:16.625115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:16.625556 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:16.688715 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:16.696644 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dad77853-c22c-4b5e-a89f-0c990628fb97 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.086487 May 10 20:42:16.697225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1146/1798] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:17.504178 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:17.504773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:17.510626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:17.511079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:17.511846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:17.512283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:17.573446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:17.581127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a078d446-f586-42cf-b417-479310b0153d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080903 May 10 20:42:17.581729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1147/1799] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:17 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:17.712385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:17.713636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:17.719886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:17.720339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:17.721140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:17.721580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:17.781164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:17.788446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bce4971d-3cf8-4a0d-bca8-c4c99b3096e7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079760 May 10 20:42:17.789015 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1148/1800] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:17 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:18.598583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:18.599193 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:18.605070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:18.605515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:18.606290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:18.606721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:18.665463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:18.673009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b045d747-8c07-461d-b6d7-f34d563d0dfd tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.078393 May 10 20:42:18.673587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1149/1801] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:18 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:18.805628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:18.806764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:18.813055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:18.813496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:18.814351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:18.814784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:18.874336 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:18.881711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f7361d18-308d-4b75-b8dd-30a20926d980 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079762 May 10 20:42:18.882316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1150/1802] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:19.690526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:19.691155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:19.697538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:19.697981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:19.698763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:19.699195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:19.760544 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:19.768404 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-467939a8-1367-4355-bc0b-92bec0518ac4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081676 May 10 20:42:19.768979 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1151/1803] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:19 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:19.898439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:19.899055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:19.905398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:19.905852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:19.906641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:19.907080 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:19.967152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:19.974441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-da1ea486-239f-4848-95f4-4f2295c5066d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079755 May 10 20:42:19.975010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1152/1804] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:20.784864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:20.794967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:20.794967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:20.794967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:20.794967 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:20.795481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:20.852858 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:20.861187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-04d39960-fa17-488f-9734-76eccd9d757c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080158 May 10 20:42:20.861751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1153/1805] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:20 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:20.990944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:20.991557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:20.997864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:20.998349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:20.999116 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:20.999557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:21.058840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:21.065919 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e879adc7-b278-4e19-906e-c7b56e27041d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078735 May 10 20:42:21.066508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1154/1806] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:21.877607 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:21.878312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:21.884075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:21.884617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:21.885397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:21.885835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:21.947417 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:21.955172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8daff994-3e31-4c18-8fb5-00d6f9f99caa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081494 May 10 20:42:21.955744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1155/1807] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:21 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:22.083233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:22.083845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:22.090767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:22.091221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:22.091988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:22.092427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:22.154542 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:22.161765 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab3d9a02-eada-435c-9c46-c37f6d278949 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082325 May 10 20:42:22.162365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1156/1808] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:22.971286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:22.971953 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:22.977844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:22.978932 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:22.979703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:22.980145 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:23.038677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:23.047021 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d3fabb8c-a976-4b67-873f-e2cc1162a0b1 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079573 May 10 20:42:23.047588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1157/1809] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:22 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:23.179435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:23.180043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:23.186384 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:23.186840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:23.187610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:23.188051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:23.260466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:23.268065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-261f62fe-4afa-405d-8f4d-1402a3cd05fd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.092778 May 10 20:42:23.268625 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1158/1810] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:24.064374 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:24.065076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:24.070911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:24.071360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:24.072128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:24.072561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:24.133088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:24.140909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bd36bb90-0d68-4580-9b96-33995e779c0d tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080514 May 10 20:42:24.143916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1159/1811] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:24 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:24.285399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:24.286012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:24.292840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:24.293293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:24.294060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:24.294521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:24.354857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:24.362202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4637da94-b06a-4caa-a522-9478fd18f281 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080620 May 10 20:42:24.362815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1160/1812] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:25.157826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:25.158685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:25.164381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:25.164837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:25.165606 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:25.166045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:25.225545 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:25.233867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f992a38a-46b2-482f-ba14-bc0b323da3b8 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079887 May 10 20:42:25.234478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1161/1813] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:25 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:25.379013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:25.379621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:25.385857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:25.386337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:25.387095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:25.387528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:25.450773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:25.458121 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b3305294-92a8-4b89-9247-80d6e79ba23d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082984 May 10 20:42:25.458687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1162/1814] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:25 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:26.251078 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:26.251733 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:26.257612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:26.258063 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:26.258847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:26.259282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:26.320150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:26.327856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-368521b0-0a82-4e82-9c4a-77bb512626a6 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080803 May 10 20:42:26.328429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1163/1815] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:26 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:26.475441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:26.476046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:26.481958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:26.482433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:26.483185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:26.483614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:26.544444 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:26.552040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b99a7e55-5e3c-46a0-8632-6c4cf60db133 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080385 May 10 20:42:26.552609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1164/1816] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:27.344731 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:27.345367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:27.351788 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:27.356628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:27.356628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:27.356628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:27.414355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:27.422128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-039ba011-bbce-41ba-a0eb-b75d4503cc3c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081254 May 10 20:42:27.422711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1165/1817] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:27 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:27.569049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:27.569620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:27.576368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:27.576816 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:27.577576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:27.578011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:27.637249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:27.644425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b795868b-e6cc-40a8-8e21-375c132eb548 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079339 May 10 20:42:27.644988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1166/1818] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:28.444792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:28.445409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:28.452307 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:28.452752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:28.453509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:28.453944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:28.517071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:28.524773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7855e7a7-f4e9-475a-b268-25f21d8509fa tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083902 May 10 20:42:28.525337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1167/1819] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:28 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:28.660348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:28.660962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:28.666742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:28.667189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:28.667952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:28.668389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:28.727430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:28.734776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f156bdfe-129b-42a4-9e46-9a8de2f77e37 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078063 May 10 20:42:28.735343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1168/1820] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:29.543302 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:29.543931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:29.549689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:29.550164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:29.551182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:29.551617 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:29.611312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:29.618902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-17cdf26b-2a0e-4dac-826c-31623bc6a44f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080687 May 10 20:42:29.619499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1169/1821] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:29 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:29.750964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:29.751580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:29.757320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:29.757771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:29.758643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:29.759086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:29.819242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:29.826453 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e772729-77d7-4ff7-b861-e08f0757a092 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079170 May 10 20:42:29.827030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1170/1822] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:30.636537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:30.637204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:30.643485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:30.643927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:30.644705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:30.645135 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:30.707337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:30.715067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-638a29cd-bb7a-4cec-874a-c575dcc47ba2 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083156 May 10 20:42:30.715628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1171/1823] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:30 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:30.842331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:30.842952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:30.848854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:30.849308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:30.850073 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:30.850540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:30.909365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:30.917110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9d2a2ce5-5a02-4d87-ac0d-310843a036ab tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078586 May 10 20:42:30.917677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1172/1824] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:30 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:31.732200 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:31.732846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:31.739204 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:31.739648 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:31.740406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:31.740838 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:31.804584 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:31.812349 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2867ad07-afa5-4cf8-92e3-c0fe2e06c593 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.084532 May 10 20:42:31.812916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1173/1825] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:31 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:31.934265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:31.934902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:31.940681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:31.941128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:31.941888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:31.942358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:32.001426 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:32.008630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-37895a17-e1d2-480a-b907-d41ad03c129b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078151 May 10 20:42:32.009210 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1174/1826] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:32.829497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:32.830259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:32.836634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:32.837087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:32.837861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:32.838332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:32.898729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:32.906497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-383f22a5-a562-4e34-8754-cfb9ab82abc5 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080905 May 10 20:42:32.907065 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1175/1827] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:32 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:33.024782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:33.025399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:33.031137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:33.031590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:33.032361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:33.032799 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:33.092019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:33.099231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3be86c6b-a76a-4491-b16f-30294880cd3d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078068 May 10 20:42:33.099818 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1176/1828] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:33.923292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:33.923957 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:33.930419 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:33.930865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:33.931620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:33.932055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:33.991438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:33.999025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68b4a6ff-17ac-46cf-b7cb-f6857b636dc0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.079689 May 10 20:42:33.999586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1177/1829] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:33 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:34.115437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:34.116057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:34.123581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:34.123581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:34.123817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:34.124088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:34.184232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:34.191515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8bbf6a15-cec8-46b4-90ca-1e024246bfae tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079916 May 10 20:42:34.192088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1178/1830] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:35.015820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:35.016479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:35.022793 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:35.023244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:35.024018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:35.024521 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:35.089861 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:35.097664 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1bdf845e-fc03-40ce-99de-c90fb3f86d0a tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.085729 May 10 20:42:35.098264 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1179/1831] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:35 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:42:35.208822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:35.209402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:35.216003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:35.216455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:35.217222 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:35.217662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:35.277448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:35.284775 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-363f534a-9eef-4082-96b9-a4aa21dc0ad3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079928 May 10 20:42:35.285341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1180/1832] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:36.115039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:36.115720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:36.122005 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:36.122482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:36.123247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:36.123686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:36.184357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:36.192041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1902de38-6a1f-4b31-9563-ae76fd25c6d4 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080877 May 10 20:42:36.192612 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1181/1833] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:36 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:36.300346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:36.301208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:36.307540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:36.307983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:36.308741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:36.309177 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:36.368022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:36.375756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-76321c60-344f-488c-ac6e-352077224e9f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079073 May 10 20:42:36.376354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1182/1834] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:37.208778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:37.209522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:37.216252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:37.216708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:37.217473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:37.217909 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:37.278554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:37.286046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c93d210a-32aa-4327-a5a0-62e67e7ef504 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081142 May 10 20:42:37.286635 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1183/1835] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:37 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:37.393030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:37.393642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:37.399514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:37.399962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:37.401224 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:37.401652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:37.467068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:37.474476 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0011beaf-2c7e-45c6-989b-13968145f658 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085332 May 10 20:42:37.475043 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1184/1836] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:38.307854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:38.308553 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:38.314929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:38.315378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:38.316128 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:38.316560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:38.377574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:38.385522 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5fe84ca5-b806-4d96-bdce-9fea816ad930 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082092 May 10 20:42:38.386122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1185/1837] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:38 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:38.491179 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:38.491798 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:38.498366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:38.498817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:38.499586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:38.500028 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:38.558952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:38.566129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6a7f58c-4c29-4991-9104-fc555ee1a78d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078761 May 10 20:42:38.566706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1186/1838] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:39.402361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:39.403076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:39.409366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:39.409813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:39.410594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:39.411029 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:39.483973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:39.491893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-484804f6-f5db-4d3f-a719-58b531c83b14 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.093524 May 10 20:42:39.492474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1187/1839] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:39 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:39.582590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:39.583203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:39.589070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:39.589523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:39.590317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:39.590760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:39.652479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:39.660064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-92172493-990d-4a3e-b4f9-ff3408f2a680 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081184 May 10 20:42:39.660640 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1188/1840] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:42:40.508994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:40.510218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:40.516540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:40.517142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:40.517884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:40.518344 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:40.579203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:40.586896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b2d99c0-71ea-4356-8024-bb7a325dd6d0 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081799 May 10 20:42:40.587471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1189/1841] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:40 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:40.676358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:40.676968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:40.682743 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:40.683149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:40.683921 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:40.684361 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:40.743356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:40.750638 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a647368-22c8-4a91-bd18-4a9ad24b103d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078097 May 10 20:42:40.751219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1190/1842] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:41.604430 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:41.605069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:41.611372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:41.611821 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:41.612588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:41.613027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:41.673161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:41.682831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c40621e9-9c3f-47c5-8a7a-a932c3f4e886 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082385 May 10 20:42:41.683400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1191/1843] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:41 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:41.767673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:41.768280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:41.773996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:41.774468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:41.775239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:41.775676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:41.837602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:41.844926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc90ae0a-461c-44bd-8c4e-fd0fc58f19c3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080936 May 10 20:42:41.845499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1192/1844] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:42.700291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:42.700938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:42.707208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:42.707665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:42.708433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:42.708876 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:42.768386 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:42.777471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-60aac1c2-0de9-4dac-ba55-05071f22b7fe tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081636 May 10 20:42:42.778301 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1193/1845] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:42 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:42.860815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:42.861427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:42.867489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:42.867936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:42.868710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:42.869140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:42.928853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:42.936350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eff27cf7-620d-4770-8ba0-f48bd485d2bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079376 May 10 20:42:42.936922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1194/1846] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:43.795292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:43.796006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:43.802527 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:43.802972 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:43.803839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:43.804296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:43.868208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:43.876401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4daed0af-33d2-4cad-bf88-7667ba03605e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.085148 May 10 20:42:43.876968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1195/1847] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:43 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:43.953077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:43.953679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:43.959251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:43.959691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:43.960616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:43.961045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:44.022943 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:44.030185 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ff581b25-370d-4278-accb-ced01c429c9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080590 May 10 20:42:44.030756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1196/1848] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:44.893996 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:44.894673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:44.900907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:44.901338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:44.902131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:44.902576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:44.962899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:44.970882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-96aa12b7-ae71-43c3-ac7b-662b66188a09 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080849 May 10 20:42:44.971456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1197/1849] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:44 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:45.047261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:45.047885 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:45.053867 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:45.054359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:45.055133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:45.055574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:45.115313 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:45.123615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b5bc76e5-74f4-4aa6-8400-1091e1bc7ca1 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080196 May 10 20:42:45.124189 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1198/1850] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:45.988674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:45.989354 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:45.995683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:45.996137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:45.996907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:45.997346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:46.057937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:46.065653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a1fe6e49-4d9a-443c-a119-2805d4ac6e4c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080886 May 10 20:42:46.066244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1199/1851] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:45 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:46.142500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:46.143202 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:46.150041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:46.150608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:46.151516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:46.151963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:46.214842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:46.222383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1d28f665-ce50-45f0-a1c5-70179b3da1d4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084611 May 10 20:42:46.223023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1200/1852] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:46 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:42:47.090700 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:47.091365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:47.097691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:47.098161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:47.098922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:47.099357 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:47.159911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:47.167493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0095797a-5278-44cf-96de-7780a411910b tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081170 May 10 20:42:47.168056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1201/1853] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:47 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:47.238989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:47.239596 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:47.245686 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:47.246279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:47.247055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:47.247494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:47.308174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:47.318131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab3262f0-616f-4541-8b0b-fbb2c1d030bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082779 May 10 20:42:47.318719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1202/1854] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:48.185165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:48.185815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:48.192146 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:48.192594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:48.193358 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:48.193790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:48.255577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:48.263331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c2077424-6665-4a75-bd13-678e0ff8fcba tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082611 May 10 20:42:48.263891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1203/1855] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:48 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:48.335282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:48.335899 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:48.342011 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:48.342604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:48.343368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:48.343836 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:48.405518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:48.412763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2dfdee23-fc63-4add-a820-9a49153e09b3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081033 May 10 20:42:48.413332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1204/1856] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:48 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:49.279888 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:49.280509 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:49.286952 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:49.287399 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:49.288160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:49.288592 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:49.350559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:49.358333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-36b81ace-6e02-41c6-8c88-618abe8f0268 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.082372 May 10 20:42:49.358913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1205/1857] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:49 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:49.430297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:49.431167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:49.437569 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:49.438024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:49.438930 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:49.439369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:49.499739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:49.507058 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3d812eab-27e3-4044-9f9c-6b700c0fb650 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080660 May 10 20:42:49.507631 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1206/1858] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:50.375889 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:50.376574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:50.382914 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:50.383364 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:50.384134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:50.384576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:50.444711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:50.452668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63867741-03fc-4c20-9fe6-b45b05b1e9b7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080655 May 10 20:42:50.453240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1207/1859] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:50 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:50.524154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:50.524763 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:50.531190 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:50.531637 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:50.532400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:50.532837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:50.594989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:50.602318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-97e376a1-38f9-4820-b190-3b7e3ce60d1d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081909 May 10 20:42:50.602893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1208/1860] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:51.469538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:51.470167 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:51.476469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:51.476922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:51.477695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:51.478162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:51.538491 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:51.546068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-14903ff9-96ed-427e-9b63-89eefb8ba716 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080508 May 10 20:42:51.546663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1209/1861] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:51 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:51.619611 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:51.620255 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:51.626012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:51.626494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:51.627260 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:51.627703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:51.687339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:51.694594 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f60dcc43-3d19-4a86-89b3-469730dea7b0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079065 May 10 20:42:51.695183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1210/1862] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:52.563122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:52.563737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:52.569981 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:52.570457 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:52.571211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:52.571643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:52.632037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:52.640201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f00b8e30-0b40-49e5-9ccf-eae05fde965c tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080953 May 10 20:42:52.640757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1211/1863] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:52 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:52.710123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:52.710734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:52.717064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:52.717504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:52.718284 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:52.718716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:52.780022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:52.787220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb88d439-7317-43a3-bbba-6279c67663a8 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080579 May 10 20:42:52.787780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1212/1864] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:53.657249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:53.657942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:53.664110 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:53.664620 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:53.665422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:53.666485 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:53.726662 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:53.734828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6b290e39-076e-44c4-a59d-ad05108d274e tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.081470 May 10 20:42:53.735397 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1213/1865] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:53 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:53.804072 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:53.804679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:53.810405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:53.810853 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:53.811615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:53.812050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:53.872479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:53.879855 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f49deeb1-598a-4810-a35d-2b1bdc47265e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079637 May 10 20:42:53.880427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1214/1866] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:53 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:54.751687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:54.752308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:54.758591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:54.759040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:54.759805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:54.760240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:54.820681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:54.830924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5556a27d-1376-4317-b18e-18c774816c0f tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.083158 May 10 20:42:54.831508 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1215/1867] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:54 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:54.896756 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:54.897359 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:54.903232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:54.903673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:54.904429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:54.904854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:54.963583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:54.970801 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63d11760-ff00-432b-b34f-433e3f8024cb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.077760 May 10 20:42:54.971366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1216/1868] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:55.849108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:55.849804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:55.856155 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:55.856613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:55.857711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:55.857833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:55.922036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:55.930186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8a8208c9-a347-4b1e-bbd4-ec9ca6042f02 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.085278 May 10 20:42:55.930844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1217/1869] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:55 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:55.987656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:55.988270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:55.994582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:55.995040 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:55.995809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:55.996250 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:56.055570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:56.063373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cdddb7c-43f7-42e9-8334-4871e5adc6ce tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079414 May 10 20:42:56.063944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1218/1870] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:55 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:56.948054 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:56.948732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:56.955019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:56.955472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:56.956244 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:56.956683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:57.016245 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:57.024059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dc18786c-1042-4434-8117-ac2d4d94e724 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080358 May 10 20:42:57.024629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1219/1871] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:56 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:57.079320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:57.079927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:57.085455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:57.085907 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:57.086711 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:57.087151 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:57.147398 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:57.155571 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c41a0be-240e-44c7-a1dd-ba9f3def26bc tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079748 May 10 20:42:57.156150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1220/1872] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:57 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:58.041251 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:58.041924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:58.048249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:58.048701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:58.049471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:58.050206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:58.109870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:58.117626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1af179ea-0af6-41b3-9658-6bb30e947dd7 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.080730 May 10 20:42:58.118220 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1221/1873] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:58 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:58.175014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:58.175712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:58.182540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:58.183068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:58.183843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:58.184274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:58.246868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:58.254259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-431db06f-e86c-4388-81f6-973a9b9db843 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085474 May 10 20:42:58.254833 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1222/1874] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:59.135998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:59.136721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] [instance: 9bb90d6b-7083-4118-94fa-736fbc886744] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:59.143137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:59.143566 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:59.144327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:59.144759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:59.220689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e46909519247119a6bc011b6bcfc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498ce5260ee44f5d9b1ebc74fecedfbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:59.227777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c3a8a4c4-fbb7-4993-848f-a0912b6c9f28 tempest-VolumesSnapshotTestJSON-2061075845 tempest-VolumesSnapshotTestJSON-2061075845-project] 10.222.0.65 "GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744" status: 200 len: 1349 microversion: 2.1 time: 0.096429 May 10 20:42:59.228353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1223/1875] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:59 2022] GET /compute/v2.1/servers/9bb90d6b-7083-4118-94fa-736fbc886744 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:42:59.270366 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:42:59.270983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:42:59.277052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:59.277516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:59.278312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:42:59.278755 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:42:59.600904 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:42:59.608842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-84c361b9-f255-4966-b859-9366314bd5bd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.342407 May 10 20:42:59.609405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1224/1876] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:42:59 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:00.625708 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:00.626473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:00.632776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:00.633229 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:00.634022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:00.634997 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:00.739230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:00.747070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-be5542d8-93c9-4263-b06e-2805856b3140 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.125257 May 10 20:43:00.747641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1225/1877] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:01.571004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:01.571504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:01.577841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:01.578297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:01.579057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:01.579499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:01.603087 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:43:01.938352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85bc9925-3969-4834-812f-334c66b1f9c0 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 204 len: 0 microversion: 2.1 time: 0.370809 May 10 20:43:01.939017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1226/1878] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:43:01 2022] DELETE /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:43:01.944144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:01.951636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:01.951636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:01.951636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:01.951636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:01.952074 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:02.014852 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:02.022332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e2b53e18-2238-4818-8574-decc983bf4cf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082276 May 10 20:43:02.022900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1227/1879] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:43:02.027339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:02.036219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:02.036219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:02.036219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:02.036219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:02.036681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:02.170865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:02.184779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a26414bf-d9ec-42ea-922e-12b08a302760 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1680 microversion: 2.1 time: 0.154982 May 10 20:43:02.184779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1228/1880] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:02 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:43:03.056446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:03.056446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:03.056446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:03.058669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:03.059481 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:03.060132 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:03.130718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:03.138276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43b5d897-ad3b-4d24-bb00-62f09f6c704e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.103462 May 10 20:43:03.139107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1229/1881] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:03 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:03.197018 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:03.197629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:03.203685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:03.204075 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:03.204843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:03.205289 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:03.271636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:03.280751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-07349c81-ef1e-4070-9abe-04c9e899a8b6 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1613 microversion: 2.1 time: 0.087841 May 10 20:43:03.282305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1230/1882] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:03 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:03.341975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-b9624346-10dc-46dd-b35c-0991c4ede918 req-f65df22d-dd0a-42f7-84a4-bfd50aa194f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f901499e-4683-464c-99fa-fcac3177ce05", "name": "network-vif-deleted", "tag": "de779ba3-95d2-4c5b-b377-c9366cb89c51"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:43:03.350368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b9624346-10dc-46dd-b35c-0991c4ede918 req-f65df22d-dd0a-42f7-84a4-bfd50aa194f0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:03.351126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b9624346-10dc-46dd-b35c-0991c4ede918 req-f65df22d-dd0a-42f7-84a4-bfd50aa194f0 service nova] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:03.363057 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-b9624346-10dc-46dd-b35c-0991c4ede918 req-f65df22d-dd0a-42f7-84a4-bfd50aa194f0 service nova] Creating event network-vif-deleted:de779ba3-95d2-4c5b-b377-c9366cb89c51 for instance f901499e-4683-464c-99fa-fcac3177ce05 on hv-cinder-82880 May 10 20:43:03.368684 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-b9624346-10dc-46dd-b35c-0991c4ede918 req-f65df22d-dd0a-42f7-84a4-bfd50aa194f0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 May 10 20:43:03.369862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1231/1883] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 20:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:43:04.155660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:04.156438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:04.163131 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:04.181079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:04.181079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:04.181079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:04.235469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:04.243053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-618e4a7e-31ac-4d23-b65c-4d4bbd09f922 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.091617 May 10 20:43:04.244194 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1232/1884] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:04.298266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:04.298969 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:04.305082 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:04.305534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:04.306992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:04.307418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:04.336814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:04.337263 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:04.337716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lazy-loading 'fault' on Instance uuid f901499e-4683-464c-99fa-fcac3177ce05 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:43:04.378045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ce1bdd6a234177ba7745d19d6fd950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c68d15d634e81acba3ca215f5548c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:04.385849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b0bc6237-efbf-409b-8ac0-a1610364e15f tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 200 len: 1331 microversion: 2.1 time: 0.091756 May 10 20:43:04.386462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1233/1885] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:04 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:05.261298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:05.261959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:05.268705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:05.269182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:05.269946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:05.270413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:05.330091 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:05.337380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0026e2e3-4243-4340-bf45-0ffd1afe78e9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080608 May 10 20:43:05.337956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1234/1886] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:05.402723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:05.403271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:05.408998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:05.409455 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:05.410253 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:05.410695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:05.423602 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 HTTP/1.1 May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:43:05.425514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:43:05.427409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'f901499e-4683-464c-99fa-fcac3177ce05'} May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:43:05.428454 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:43:05.430197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:43:05.432248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:43:05.432248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bfa2b4ee-2cfa-4f3f-8eb9-eedd161c9b37 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 404 len: 111 microversion: 2.1 time: 0.027835 May 10 20:43:05.432248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1235/1887] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:05 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:43:05.435668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-56ad1147-d525-4f12-be00-73e7c6bc72bd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '.version_select at 0x7f6029131ca0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:05.510973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-56ad1147-d525-4f12-be00-73e7c6bc72bd tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199234250" status: 202 len: 0 microversion: 2.1 time: 0.078423 May 10 20:43:05.511560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1236/1888] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 10 20:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199234250 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:43:06.354822 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:06.355507 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:06.363825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:06.364274 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:06.365036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:06.365469 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:06.425166 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:06.432562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-797c08f3-942e-4949-a1ce-9e9d5f0b2094 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082159 May 10 20:43:06.433122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1237/1889] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:06 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:07.449303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:07.449912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:07.456310 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:07.456757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:07.457513 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:07.457944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:07.522619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:07.530061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5cb71021-9a26-463b-a630-b43370d6a933 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085221 May 10 20:43:07.530650 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1238/1890] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:07 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:08.547392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:08.548003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:08.554879 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:08.555331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:08.556760 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:08.557225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:08.616519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:08.624516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad9bd8b0-869c-47d3-b02a-fe8805bb4220 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081079 May 10 20:43:08.625090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1239/1891] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:09.642208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:09.642863 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:09.648994 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:09.649438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:09.650886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:09.651317 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:09.710546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:09.717677 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-55c3c969-0131-41b0-8896-a5fae8a97ce5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079539 May 10 20:43:09.718290 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1240/1892] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:09 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:10.735037 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:10.735706 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:10.742378 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:10.742824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:10.743589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:10.744023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:10.803517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:10.810669 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc24d49e-78f0-4043-8677-cb5dba570f8e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079539 May 10 20:43:10.811240 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1241/1893] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:11.827330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:11.828036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:11.834282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:11.834732 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:11.835499 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:11.835936 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:11.895114 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:11.902813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a329529-765a-459a-bd44-0d1314750dde tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079332 May 10 20:43:11.903377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1242/1894] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:11 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:12.920049 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:12.920681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:12.927468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:12.927917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:12.928690 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:12.929127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:12.993604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:13.001416 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9ad4837-e346-494c-a594-b65a0b4bbb1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085299 May 10 20:43:13.001989 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1243/1895] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:14.018296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:14.018983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:14.025133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:14.025579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:14.026368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:14.026808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:14.086370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:14.093668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d2ac93a9-6a29-43aa-b222-277d0a2eb7bb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079301 May 10 20:43:14.094265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1244/1896] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:14 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:15.110983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:15.111670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:15.118013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:15.118497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:15.119772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:15.120211 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:15.179246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:15.187010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d35130e6-3a5b-4f7a-87cf-6b7c9bdf876b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079904 May 10 20:43:15.187579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1245/1897] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:16.203109 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:16.203781 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:16.210023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:16.210519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:16.211294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:16.211740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:16.271246 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:16.278593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f0a1eed-9ec3-456d-b71c-6acdef7406aa tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079365 May 10 20:43:16.279162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1246/1898] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:17.295046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:17.295693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:17.302242 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:17.302687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:17.303441 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:17.303870 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:17.365530 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:17.373197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b84bc650-f980-45b3-b349-7e9f91246818 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082016 May 10 20:43:17.373782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1247/1899] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:17 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:18.389456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:18.390181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:18.396466 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:18.396912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:18.397682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:18.398137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:18.459905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:18.467293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab5f3a80-df77-44a8-a549-d166c55bb1b5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081858 May 10 20:43:18.467868 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1248/1900] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:19.484266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:19.484892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:19.491303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:19.491780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:19.492547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:19.492983 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:19.560814 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:19.568352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80bd9f1b-a555-49e1-8476-05551d00243c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.087994 May 10 20:43:19.568912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1249/1901] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:20.585784 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:20.586435 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:20.593563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:20.594014 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:20.594808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:20.595280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:20.654478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:20.661764 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0fa51228-2e24-4782-9469-9c2b844edb9d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079919 May 10 20:43:20.662371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1250/1902] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:21.679061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:21.679727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:21.686381 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:21.686829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:21.687590 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:21.688024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:21.750442 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:21.757656 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-efb84f17-0988-496c-bd1e-77ccb77def32 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082531 May 10 20:43:21.758241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1251/1903] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:21 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:22.775587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:22.776230 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:22.782514 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:22.782968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:22.783740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:22.784180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:22.843922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:22.851257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad617674-63ce-4885-b3d5-2f25f36b04ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080248 May 10 20:43:22.851831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1252/1904] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:22 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:23.868076 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:23.869332 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:23.875443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:23.875893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:23.876661 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:23.877100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:23.936586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:23.943840 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-608d10b6-614d-4545-b93a-bfd1cfcb3536 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079715 May 10 20:43:23.944415 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1253/1905] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:24.960468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:24.961148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:24.967895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:24.968350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:24.969120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:24.969560 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:25.030472 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:25.042903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a4b2b59-7c3a-41a9-a3f7-f1677a352a7e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081012 May 10 20:43:25.042903 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1254/1906] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:26.054593 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:26.055282 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:26.061718 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:26.062205 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:26.062976 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:26.063414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:26.126766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:26.134025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19300899-ae3b-424f-969d-b595bac3150f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083362 May 10 20:43:26.134615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1255/1907] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:27.151262 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:27.151927 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:27.158285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:27.158742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:27.159518 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:27.159978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:27.221913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:27.230001 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f0f3ccba-8ef1-4859-8ac2-dc49b63acfc6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083091 May 10 20:43:27.230641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1256/1908] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:28.248103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:28.248794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:28.255055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:28.255503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:28.256267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:28.256704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:28.315490 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:28.322787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b3578a6f-ea8d-4b36-b161-f3485caa0ab5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079250 May 10 20:43:28.323353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1257/1909] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:29.339122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:29.339740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:29.346134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:29.346582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:29.347346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:29.347777 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:29.413906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:29.421342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-245f0ed8-dcd3-4438-9a06-9cf6c98bd935 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.086095 May 10 20:43:29.421924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1258/1910] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:30.438935 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:30.439558 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:30.445931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:30.446925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:30.447694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:30.448133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:30.509728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:30.517026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ee55d2f-2552-4306-980a-f0ed20211eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081972 May 10 20:43:30.517597 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1259/1911] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:30 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:31.005973 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:43:31.006214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:43:31.534277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:31.534925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:31.541329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:31.541782 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:31.542580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:31.543020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:31.603694 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:31.611192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7033a0b-f225-4a63-8e10-3a402ecda430 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080773 May 10 20:43:31.611778 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1260/1912] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:32.628622 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:32.629261 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:32.636085 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:32.636537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:32.637311 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:32.637751 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:32.697330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:32.704579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df1adbc9-965a-426a-ae64-4224f5172888 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079901 May 10 20:43:32.705172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1261/1913] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:33.721752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:33.722525 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:33.728653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:33.729104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:33.729865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:33.730338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:33.791614 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:33.799153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4f6e0d63-7e74-4cc2-87b2-4f6e2d894ea3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081059 May 10 20:43:33.799729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1262/1914] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:34.816651 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:34.817285 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:34.824019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:34.824474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:34.825243 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:34.825685 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:34.889494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:34.896759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5363f3c7-b2da-4449-b9e5-04c9ecbb2d4e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084074 May 10 20:43:34.897333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1263/1915] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:35.914280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:35.915585 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:35.921848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:35.922338 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:35.923100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:35.923790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:35.983891 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:35.991298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5564658c-d3b6-41b8-a03e-c5bf49182313 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080840 May 10 20:43:35.991873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1264/1916] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:37.008036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:37.009219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:37.015529 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:37.015982 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:37.016754 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:37.017201 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:37.076825 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:37.084583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f40fc273-3151-4fde-a976-f27674ff886a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080329 May 10 20:43:37.085182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1265/1917] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:43:38.101934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:38.103140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:38.109333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:38.109794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:38.110660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:38.111101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:38.171829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:38.179547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-224585f4-8bcb-41a2-8140-befd874372f5 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081475 May 10 20:43:38.180122 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1266/1918] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:39.196467 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:39.197157 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:39.203413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:39.203869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:39.204643 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:39.205083 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:39.268549 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:39.277370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-328fe857-48d0-42ac-984c-47d0082adbcd tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084922 May 10 20:43:39.278144 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1267/1919] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:40.294848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:40.295548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:40.302605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:40.303055 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:40.303830 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:40.304267 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:40.364027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:40.371429 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bb6902e1-1891-46f7-9acb-fd563b4319b9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081033 May 10 20:43:40.371984 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1268/1920] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:41.389068 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:41.389713 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:41.396298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:41.396767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:41.397561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:41.398041 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:41.464748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:41.472278 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9cb31f71-dfa0-4e60-84bf-434e6f61178a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.087736 May 10 20:43:41.472845 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1269/1921] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:41 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:42.489418 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:42.490034 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:42.496330 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:42.496780 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:42.497534 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:42.497964 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:42.556837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:42.564111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a76ab80-2efa-4653-9d81-e6f33b65efbf tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078507 May 10 20:43:42.564683 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1270/1922] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:43.580812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:43.581379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:43.587721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:43.588172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:43.588937 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:43.589376 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:43.657846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:43.665843 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-307a1aeb-2a0a-4090-84be-822f71822cb7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.088838 May 10 20:43:43.666462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1271/1923] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:44.689306 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:44.689950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:44.696215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:44.696665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:44.697431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:44.697865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:44.757842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:44.767505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c5be7ae-7f21-4a5f-8049-b67b9ac9ceec tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080567 May 10 20:43:44.769276 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1272/1924] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:44 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:45.787628 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:45.788316 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:45.795241 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:45.795691 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:45.796450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:45.796886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:45.856380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:45.863682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-70d375b4-c0be-4f0f-aada-79d1636d4391 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079956 May 10 20:43:45.864254 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1273/1925] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:46.880615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:46.881266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:46.887483 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:46.887924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:46.888687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:46.889118 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:46.948104 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:46.955208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-026983e4-77bc-4384-8ab4-e9fcf0f7eea4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078609 May 10 20:43:46.955773 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1274/1926] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:46 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:47.971727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:47.972498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:47.978646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:47.979088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:47.979848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:47.980277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:48.041962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:48.049479 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7515bb9-897d-4dee-affd-810a30d8d90e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081608 May 10 20:43:48.050039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1275/1927] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:49.066016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:49.066790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:49.073473 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:49.074148 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:49.074710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:49.075152 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:49.136615 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:49.143878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-41a59d44-92dc-4312-bcf8-14ad18dee5c2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081710 May 10 20:43:49.144451 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1276/1928] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:50.160776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:50.161489 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:50.167828 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:50.168271 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:50.169032 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:50.169459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:50.228895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:50.236207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-acee00ca-1bb2-4af2-b373-42a13a7d8510 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079342 May 10 20:43:50.236772 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1277/1929] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:51.252804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:51.253443 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:51.259742 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:51.260692 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:51.261448 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:51.261880 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:51.321039 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:51.328862 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-014e5c76-4928-42e1-abdf-de439592ddac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079942 May 10 20:43:51.329433 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1278/1930] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:52.345895 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:52.346536 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:52.352823 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:52.353268 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:52.354031 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:52.354493 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:52.416160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:52.425884 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d32cf831-b41b-4e06-9bd9-5fc54bc5d057 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083610 May 10 20:43:52.427130 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1279/1931] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:53.443468 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:53.444084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:53.451133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:53.451583 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:53.452350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:53.452791 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:53.512084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:53.519318 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85163592-3a20-4597-961a-e5f99bea38da tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080229 May 10 20:43:53.519893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1280/1932] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:53 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:43:54.535701 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:54.536383 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:54.542663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:54.543107 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:54.543985 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:54.544414 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:54.605053 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:54.612423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-10429e2b-a692-4eef-aec7-ceefcbe07e6a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080687 May 10 20:43:54.612998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1281/1933] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:55.629537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:55.630228 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:55.637051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:55.637501 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:55.638297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:55.638735 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:55.701027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:55.708296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-691c4f70-d918-47aa-bc95-ee0d5830aebb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082719 May 10 20:43:55.708892 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1282/1934] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:55 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:56.730465 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:56.731106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:56.737218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:56.737670 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:56.738456 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:56.738893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:56.800905 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:56.808239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6e9331a6-e11e-46a8-9558-6ad00568b26e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082650 May 10 20:43:56.808857 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1283/1935] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:56 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:57.827008 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:57.827727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:57.833940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:57.834428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:57.835197 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:57.835641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:57.894820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:57.902142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-81e80986-fd74-4627-8040-db26c6d921f2 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078965 May 10 20:43:57.903247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1284/1936] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:57 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:43:58.919557 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:43:58.920216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:43:58.926681 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:58.927134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:58.927898 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:43:58.928341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:43:58.987256 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:43:58.994460 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1b47cc77-a8d2-4d28-a584-d8485c455b9e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078894 May 10 20:43:58.995023 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1285/1937] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:43:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:00.011539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:00.012236 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:00.018452 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:00.018900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:00.019660 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:00.020090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:00.079170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:00.086368 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2a0004be-ae33-40bf-8673-6bb2eb75187a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078618 May 10 20:44:00.086934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1286/1938] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:01.103174 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:01.103839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:01.110391 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:01.110834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:01.111911 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:01.112459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:01.175610 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:01.183042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-63c53be8-3e12-4b53-bea9-35e041c02eee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083734 May 10 20:44:01.184103 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1287/1939] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:02.201004 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:02.201688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:02.208020 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:02.208471 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:02.209235 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:02.209671 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:02.269239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:02.276463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2f1ab52d-b696-4a7c-a464-d2313608449c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080024 May 10 20:44:02.277030 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1288/1940] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:02 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:03.293786 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:03.294406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:03.301081 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:03.301526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:03.302320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:03.302757 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:03.367411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:03.375551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bbf938cf-08e4-4068-9af0-8adb3f72789f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.085732 May 10 20:44:03.376150 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1289/1941] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:03 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:04.392252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:04.392928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:04.399206 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:04.399689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:04.400449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:04.400887 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:04.462059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:04.470036 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6967e44c-3115-4492-903e-791d36b67b16 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081682 May 10 20:44:04.470621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1290/1942] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:04 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:05.487339 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:05.487950 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:05.494355 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:05.494805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:05.495572 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:05.496009 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:05.558175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:05.565478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-167eb551-1473-47f7-854d-d1e9acfabca9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082009 May 10 20:44:05.566046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1291/1943] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:05 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:06.582183 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:06.582797 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:06.589052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:06.589500 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:06.590300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:06.590737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:06.649954 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:06.657427 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c37381d-badb-42b7-a8a2-b6306151842b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079225 May 10 20:44:06.657998 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1292/1944] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:06 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:07.675119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:07.675762 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:07.681931 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:07.682403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:07.683161 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:07.683595 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:07.751790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:07.759233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bfa7cb74-bacf-40c4-a1e0-a772b5b0792c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.088302 May 10 20:44:07.759805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1293/1945] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:07 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:08.775975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:08.776642 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:08.782945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:08.783400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:08.784169 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:08.784616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:08.843958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:08.851159 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-73b1fc34-640d-437e-aa18-28219f4d480b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079060 May 10 20:44:08.851724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1294/1946] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:08 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:09.868659 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:09.869348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:09.876273 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:09.876721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:09.877494 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:09.877928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:09.942303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:09.949581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0e7043cd-f7b4-4bf1-9a06-73a0a0d7949f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084943 May 10 20:44:09.950170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1295/1947] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:09 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:10.966292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:10.966959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:10.973153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:10.973604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:10.974394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:10.974835 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:11.033703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:11.040974 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a2b9812-498e-43e0-92d0-3a00df24a3d0 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078605 May 10 20:44:11.041548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1296/1948] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:10 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:12.058978 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:12.059653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:12.067292 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:12.067749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:12.068517 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:12.068962 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:12.128565 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:12.135748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e5726e64-ec5c-4d25-8b7f-ff527843d856 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081085 May 10 20:44:12.136820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1297/1949] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:12 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:13.153170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:13.153872 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:13.160105 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:13.160548 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:13.161298 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:13.161727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:13.220815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:13.228002 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b64bce90-c376-4a2e-b6db-75d353d62c4c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079203 May 10 20:44:13.228570 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1298/1950] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:13 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:14.244727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:14.245459 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:14.252280 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:14.252727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:14.253486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:14.254071 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:14.317409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:14.324893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c8de2f31-6fa7-498f-be28-8b5422acdecb tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084082 May 10 20:44:14.325461 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1299/1951] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:14 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:15.341771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:15.342401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:15.348676 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:15.349123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:15.349890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:15.350356 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:15.409450 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:15.416663 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6fe6cfd7-c395-4a5f-bbcc-013ddfe55681 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078816 May 10 20:44:15.417233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1300/1952] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:15 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:16.433723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:16.434360 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:16.440689 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:16.441134 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:16.441893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:16.442350 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:16.502912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:16.510668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc87adca-500d-4ab9-9e4f-65aff39998f9 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080766 May 10 20:44:16.511761 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1301/1953] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:16 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:17.529294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:17.530216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:17.537327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:17.537796 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:17.538619 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:17.539172 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:17.600551 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:17.609165 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bf92c54a-a023-4c9a-a5a2-5291e607ec6b tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.084478 May 10 20:44:17.609738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1302/1954] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:17 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:18.626407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:18.627115 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:18.633238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:18.633678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:18.634458 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:18.634890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:18.697963 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:18.705297 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d10933a1-11b0-432d-ace7-13269e045bff tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082729 May 10 20:44:18.705859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1303/1955] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:18 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:19.722652 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:19.723382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:19.729248 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:19.729705 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:19.730502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:19.730942 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:19.791820 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:19.799550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5f2f4a02-ba99-4607-8363-e9ed839c8cb3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081256 May 10 20:44:19.800129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1304/1956] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:19 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:20.820111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:20.820758 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:20.827523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:20.827980 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:20.828749 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:20.829192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:20.888668 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:20.896013 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e5afe376-dd2d-4773-bcfe-988a371de560 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079830 May 10 20:44:20.896580 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1305/1957] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:20 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:21.913405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:21.914119 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:21.920944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:21.921389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:21.922437 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:21.922871 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:21.981645 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:21.988771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5e946ff1-251d-4d21-b6e3-8b3e3fd07a0d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079221 May 10 20:44:21.989334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1306/1958] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:21 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:23.005066 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:23.005808 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:23.012604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:23.013061 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:23.013844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:23.014321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:23.077067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:23.084498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfc9c82f-ae32-47c1-8d89-1ab812038aee tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083251 May 10 20:44:23.085111 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1307/1959] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:23 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:24.101846 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:24.102559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:24.108747 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:24.109192 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:24.109946 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:24.110403 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:24.172334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:24.179463 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c80498c4-4ecc-42a8-82da-548370f37777 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081468 May 10 20:44:24.180024 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1308/1960] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:24 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:25.196698 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:25.197394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:25.204249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:25.204695 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:25.205449 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:25.205882 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:25.427321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:25.435305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a3780bb-efa6-498d-82cf-12411143babe tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.242463 May 10 20:44:25.435873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1309/1961] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:25 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:26.452809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:26.453432 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:26.459405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:26.459856 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:26.460613 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:26.461052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:26.521334 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:26.532003 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5d54f2b8-1c32-460a-a92b-742b8463d72d tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083488 May 10 20:44:26.532819 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1310/1962] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:26 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:27.549256 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:27.549842 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:27.556136 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:27.556582 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:27.557342 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:27.558446 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:27.627577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:27.634859 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7182c4dc-7b44-48b1-af5c-dcd1185bb677 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.089748 May 10 20:44:27.635423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1311/1963] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:27 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:28.651337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:28.652538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:28.658737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:28.659180 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:28.659938 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:28.660377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:28.967299 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:28.974573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e3c71744-e6cd-4c61-85c6-2ca52be62ba4 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.327191 May 10 20:44:28.975127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1312/1964] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:28 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:29.991343 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:29.992052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:29.998380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:29.998837 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:29.999608 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:30.000048 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:30.059214 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:30.066515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-561cca14-2db0-49e7-8096-57e20d69c567 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079072 May 10 20:44:30.067084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1313/1965] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:29 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:31.083923 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:31.084588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:31.090893 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:31.091346 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:31.092120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:31.092562 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:31.151238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:31.158352 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-06d4695b-29e9-4d04-974d-42f2b5f073b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078279 May 10 20:44:31.158906 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1314/1966] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:31 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:44:32.175369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:32.176064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:32.182353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:32.182805 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:32.183573 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:32.184012 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:32.244741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:32.252062 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-06c0fa8b-b6dd-4473-b065-89692d214a83 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080880 May 10 20:44:32.252618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1315/1967] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:32 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:33.268707 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:33.269321 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:33.275587 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:33.277776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:33.277776 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:33.278059 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:33.340598 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:33.347815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5013cdf3-93e3-4475-b32e-488ba8c5661e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082964 May 10 20:44:33.348370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1316/1968] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:33 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:34.364727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:34.365380 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:34.372341 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:34.374633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:34.374633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:34.374633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:34.432581 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:34.440535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cae2b7c2-88bc-41d7-968d-01247252732f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079753 May 10 20:44:34.441101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1317/1969] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:34 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:35.457129 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:35.457779 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:35.464100 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:35.464554 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:35.465327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:35.465767 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:35.524540 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:35.531809 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-23fb1161-b378-4c40-a29f-b3691945ee07 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078520 May 10 20:44:35.532372 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1318/1970] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:35 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:36.549239 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:36.549854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:36.556266 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:36.556740 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:36.557506 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:36.557945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:36.616741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:36.624744 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-162bb730-6ada-4ca3-9b3a-e40babb7f4c7 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079630 May 10 20:44:36.625305 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1319/1971] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:36 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:37.642142 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:37.642728 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:37.649017 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:37.649474 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:37.650277 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:37.650724 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:37.710714 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:37.718044 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68fc11a4-eb85-43fc-a62b-3e79233be2c6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079938 May 10 20:44:37.718632 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1320/1972] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:37 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:38.735719 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:38.736377 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:38.742727 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:38.743184 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:38.743959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:38.744400 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:38.810407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:38.817737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5845bef5-17a5-4de7-8774-9ae2493aca1f tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.086211 May 10 20:44:38.818335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1321/1973] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:38 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:39.835170 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:39.835847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:39.842052 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:39.842533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:39.843300 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:39.843739 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:39.906108 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:39.913351 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-538a775e-411c-4b27-b5db-904eaa240a38 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082061 May 10 20:44:39.913913 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1322/1974] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:39 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:40.931095 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:40.931741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:40.938045 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:40.938531 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:40.939287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:40.939721 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:40.999370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:41.006538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9f00594e-e18d-4498-98d8-a8fe13ae6d73 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079293 May 10 20:44:41.007101 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1323/1975] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:40 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:42.023926 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:42.024616 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:42.031431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:42.031878 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:42.032633 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:42.033067 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:42.092675 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:42.100064 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-beed6b23-632a-4e09-8111-9a6dd0c1753e tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080001 May 10 20:44:42.100624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1324/1976] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:42 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:43.117283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:43.117975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:43.124293 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:43.124741 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:43.125505 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:43.125939 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:43.185546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:43.192988 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dbfa8e8a-2b2f-4ec8-b97e-1d7787fad1a3 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079576 May 10 20:44:43.193680 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1325/1977] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:43 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:44.209848 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:44.210574 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:44.216912 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:44.217367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:44.218175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:44.218621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:44.281249 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:44.288986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8d9d457a-8e35-4fc6-940f-427f7cc9a580 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082960 May 10 20:44:44.289564 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1326/1978] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:44 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:45.306411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:45.307025 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:45.313849 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:45.314327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:45.315086 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:45.315526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:45.374559 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:45.381665 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a304d88b-ab33-4400-b040-472a73619c59 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079150 May 10 20:44:45.382258 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1327/1979] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:45 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:46.399160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:46.399854 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:46.406774 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:46.407225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:46.407993 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:46.408428 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:46.470394 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:46.477753 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-65005c5d-3b42-44e8-ad9e-96b06555bda6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082447 May 10 20:44:46.478365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1328/1980] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:46 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:47.494123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:47.494752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:47.501153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:47.501604 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:47.502392 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:47.502829 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:47.562539 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:47.569815 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db82aedc-de43-4a6f-b4c9-d7b393a70252 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079594 May 10 20:44:47.570412 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1329/1981] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:47 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:48.586934 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:48.587588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:48.594533 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:48.594991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:48.595792 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:48.596233 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:48.655629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:48.662873 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a03b77fb-d0eb-4891-9dab-832bf84857b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079869 May 10 20:44:48.663447 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1330/1982] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:48 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:49.679881 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:49.680563 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:49.686737 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:49.687181 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:49.687940 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:49.688371 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:49.750176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:49.757388 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db08eaab-9969-4570-b461-1c43a5056a40 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081451 May 10 20:44:49.757956 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1331/1983] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:49 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:50.774679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:50.775186 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:50.781464 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:50.781917 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:50.782729 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:50.783162 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:50.842496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:50.849771 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d433881b-e33f-4367-a509-088241456154 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079120 May 10 20:44:50.850373 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1332/1984] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:50 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:51.868218 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:51.868890 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:51.875865 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:51.876309 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:51.877070 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:51.877502 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:51.940312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:51.947577 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-777204a0-71f5-4224-9784-97fdf48a97b6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083218 May 10 20:44:51.948156 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1333/1985] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:51 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:52.965326 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:52.965992 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:52.972287 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:52.972738 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:52.973504 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:52.973945 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:53.036995 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:53.044272 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-048b119a-1ac7-4ddd-b926-f64394bfd941 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.083462 May 10 20:44:53.044841 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1334/1986] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:52 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:54.061925 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:54.062646 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:54.068812 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:54.069257 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:54.070022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:54.070482 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:54.132477 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:54.139748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb505d64-0cec-4c9f-aeb7-3d7255c679ac tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082367 May 10 20:44:54.140314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1335/1987] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:54 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:55.156516 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:55.157207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:55.163462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:55.163915 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:55.164688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:55.165126 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:55.225168 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:55.232922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9862c3b7-818f-421b-9e67-b83c4e44e589 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.080345 May 10 20:44:55.233497 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1336/1988] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:55 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:56.249579 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:56.250294 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:56.256154 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:56.256600 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:56.257353 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:56.257787 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:56.316922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:56.324726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58dd546b-cdfc-41fb-b3a0-f3a6c2061d60 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.078489 May 10 20:44:56.325296 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1337/1989] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:56 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:57.340666 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:57.341312 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:57.347794 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:57.348252 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:57.349019 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:57.349462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:57.409056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:57.416434 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bf0d7228-dd37-4947-9ff0-f1ddf0f4ac79 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079597 May 10 20:44:57.417010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1338/1990] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:57 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:58.433010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:58.433759 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:58.440084 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:58.440528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:58.441286 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:58.441716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:58.503874 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:58.511195 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a5f4d2a-56c8-4472-921b-a2623913767c tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.082150 May 10 20:44:58.512295 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1339/1991] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:58 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:44:59.529088 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:44:59.529716 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:44:59.536007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:59.536462 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:59.537234 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:44:59.537678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:44:59.597329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:44:59.604546 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e72cead4-7691-45ec-a0c8-86fc174342df tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079908 May 10 20:44:59.605120 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1340/1992] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:44:59 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:45:00.621674 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:45:00.622348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:45:00.628703 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:00.629160 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:00.629924 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:00.630406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:00.691832 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:45:00.699550 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bf76db7d-dcc0-4955-a021-1f3f1cc6afa6 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.081405 May 10 20:45:00.700127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1341/1993] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:45:00 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:45:01.717498 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:45:01.718191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: f43b1f37-3eff-4ece-bf7e-8dc94657366f] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:45:01.724382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:01.724826 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:01.725586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:01.726016 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:01.784896 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46916c5b15254c529bc52ecb711fdd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dce3ce114d427895f446e0ed0f7e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:45:01.792140 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd4fb81f-563d-438f-8bbc-f4c705ac823a tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f" status: 200 len: 1224 microversion: 2.1 time: 0.079232 May 10 20:45:01.793519 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1342/1994] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:45:01 2022] GET /compute/v2.1/servers/f43b1f37-3eff-4ece-bf7e-8dc94657366f => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:45:02.349723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:45:02.350259 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:45:02.356191 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:02.356641 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:02.357411 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:02.357847 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:02.371528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] HTTP exception thrown: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Request method failure captured: May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d HTTP/1.1 May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesjRlloT3y7c_S8w-0jnG6uodWut4Bc5QmaKowhbdGgx4vtVmc0IMC-IbQZOZ2huX-rN5CHz8GFYe1N8G72JncWuMj2MPCbj-rE3F39N5x2HclVirc0UxKk_5NyVn2yTKGmcWXYndbH32w4Ku8-kPYJvO3A50vwOd9zlvE2lTwarNcg May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:45:02.373079 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_93dce3ce114d427895f446e0ed0f7e4f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-312230550-project May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 46916c5b15254c529bc52ecb711fdd76 May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-312230550-project May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.374804 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '0f9c1d58-2493-43f6-b011-90a3bac5ac0d'} May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:45:02.376221 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.377844 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.380223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Returning 404 to user: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:45:02.380223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ecf5c71-9bae-488d-8ca5-4f53e7fc9e51 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 404 len: 111 microversion: 2.1 time: 0.028812 May 10 20:45:02.380223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1343/1995] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:45:02 2022] DELETE /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:45:02.383010 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:45:02.383621 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] [instance: 0f9c1d58-2493-43f6-b011-90a3bac5ac0d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:45:02.389928 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:02.390407 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:02.391176 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:45:02.391618 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:45:02.404864 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] HTTP exception thrown: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Request method failure captured: May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d HTTP/1.1 May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesjRlloT3y7c_S8w-0jnG6uodWut4Bc5QmaKowhbdGgx4vtVmc0IMC-IbQZOZ2huX-rN5CHz8GFYe1N8G72JncWuMj2MPCbj-rE3F39N5x2HclVirc0UxKk_5NyVn2yTKGmcWXYndbH32w4Ku8-kPYJvO3A50vwOd9zlvE2lTwarNcg May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:45:02.413231 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/93dce3ce114d427895f446e0ed0f7e4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_93dce3ce114d427895f446e0ed0f7e4f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 93dce3ce114d427895f446e0ed0f7e4f May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-312230550 May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-312230550-project May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 46916c5b15254c529bc52ecb711fdd76 May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-312230550-project May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.415423 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '0f9c1d58-2493-43f6-b011-90a3bac5ac0d'} May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:45:02.416385 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. May 10 20:45:02.418225 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:45:02.419769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Returning 404 to user: Instance 0f9c1d58-2493-43f6-b011-90a3bac5ac0d could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:45:02.419769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7e0f0ce1-24ca-436e-9daf-68e876ff8a19 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d" status: 404 len: 111 microversion: 2.1 time: 0.028435 May 10 20:45:02.419769 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1344/1996] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:45:02 2022] GET /compute/v2.1/servers/0f9c1d58-2493-43f6-b011-90a3bac5ac0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:45:16.050090 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:45:16.050766 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:45:21.395523 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:45:21.396123 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:46:51.015291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:46:51.016027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:48:36.057949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:48:36.058682 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:48:41.403528 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:48:41.404693 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:50:11.024439 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:50:11.025112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:50:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:51:02.082968 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 20:51:02.086831 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:51:02.087329 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:51:02.094007 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.094496 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.095265 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.095704 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.108503 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 HTTP/1.1 May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:51:02.110216 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.112137 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'f901499e-4683-464c-99fa-fcac3177ce05'} May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:51:02.113223 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.115333 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.117102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:51:02.117102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af3ee1b7-6a99-46af-8300-f3341f658a85 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 404 len: 111 microversion: 2.1 time: 0.031430 May 10 20:51:02.117102 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1345/1997] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:51:02 2022] DELETE /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:51:02.119279 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:51:02.119883 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: f901499e-4683-464c-99fa-fcac3177ce05] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:51:02.125382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.125824 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.126605 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.127127 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.140790 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 HTTP/1.1 May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:51:02.142369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.144050 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'f901499e-4683-464c-99fa-fcac3177ce05'} May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:51:02.144922 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. May 10 20:51:02.146734 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.148405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance f901499e-4683-464c-99fa-fcac3177ce05 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:51:02.148405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-33582f0b-f850-46fa-833a-f7325a342449 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05" status: 404 len: 111 microversion: 2.1 time: 0.027887 May 10 20:51:02.148405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1346/1998] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:51:02 2022] GET /compute/v2.1/servers/f901499e-4683-464c-99fa-fcac3177ce05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:51:02.151877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:51:02.152365 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:51:02.158783 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.159232 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.160000 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.160438 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.173752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 HTTP/1.1 May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:51:02.175314 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.177215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'cc41ee43-26c2-4b80-b44d-1efb5a10b299'} May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:51:02.178410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.180182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.182077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:51:02.182077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e1b79aa6-7c49-477d-b33d-712d01ffea19 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 404 len: 111 microversion: 2.1 time: 0.028389 May 10 20:51:02.182077 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1347/1999] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:51:02 2022] DELETE /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:51:02.184431 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:51:02.185027 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: cc41ee43-26c2-4b80-b44d-1efb5a10b299] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:51:02.190515 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.190959 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.191710 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:51:02.192141 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:51:02.205624 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 HTTP/1.1 May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:51:02.207149 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.208949 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'cc41ee43-26c2-4b80-b44d-1efb5a10b299'} May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:51:02.210051 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. May 10 20:51:02.211752 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:51:02.213478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance cc41ee43-26c2-4b80-b44d-1efb5a10b299 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:51:02.213478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f21d5428-ec8a-4c9f-88b1-041a1e672825 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299" status: 404 len: 111 microversion: 2.1 time: 0.027502 May 10 20:51:02.213478 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1348/2000] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:51:02 2022] GET /compute/v2.1/servers/cc41ee43-26c2-4b80-b44d-1efb5a10b299 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:51:03.333561 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7ab70695-8e0d-488c-b46e-4126830d6458 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] Calling method '.version_select at 0x7f6028f598b0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:51:03.354725 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 51618. May 10 20:51:03.411367 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7ab70695-8e0d-488c-b46e-4126830d6458 tempest-TestVolumeBootPattern-312230550 tempest-TestVolumeBootPattern-312230550-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-603570155" status: 202 len: 0 microversion: 2.1 time: 0.081820 May 10 20:51:03.412026 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1349/2001] 10.222.0.65 () {58 vars in 1259 bytes} [Tue May 10 20:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-603570155 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:52:01.412547 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:52:01.413247 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:53:31.032586 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:53:31.033238 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:53:36.067810 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:53:36.068827 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:53:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:55:21.420345 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:55:21.420961 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:56:51.040291 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:56:51.040971 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:56:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:56:56.076382 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:56:56.076908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:57:02.726537 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 20:57:02.730335 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:02.730834 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:57:02.737369 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:57:02.737817 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:57:02.738609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:57:02.739047 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:57:02.751860 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 HTTP/1.1 May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:02.753422 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:02.754813 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '4c370a2b-a8cd-4cbf-ba4c-48b870291ba3'} May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:02.755634 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:02.757056 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:02.758402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:02.758402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3277473-a610-452d-b89f-8757a9e9b7cf tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 404 len: 111 microversion: 2.1 time: 0.030130 May 10 20:57:02.758402 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1350/2002] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 20:57:02 2022] DELETE /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:57:02.985303 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:02.986526 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] [instance: 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:57:02.993916 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:57:02.994406 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:57:02.995182 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:57:02.995626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Lock "af367fc0-4f9a-4803-8740-8f77fd786c48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:57:03.008576 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] HTTP exception thrown: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Request method failure captured: May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 HTTP/1.1 May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABiesoI58C5-7za8hbTeo1WAe1avwewP1Av2bkpbC6t_p_UNvJ7FyCBCXpAcJ2Hy0XRWVmiG_737Pf-DQLDu1XwBgfPFxTRwhS_GC9rLNwsMO74a3SHmFn5vRDb49Lmk9WnLM3VXgvwNGTamK_XXd-QJNTO5nl2NwjPgLgUIdbo3686Xek May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:03.010106 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1d1c68d15d634e81acba3ca215f5548c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1d1c68d15d634e81acba3ca215f5548c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 1d1c68d15d634e81acba3ca215f5548c May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1824481913 May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 04ce1bdd6a234177ba7745d19d6fd950 May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-1824481913-project May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: > May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:03.011425 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '4c370a2b-a8cd-4cbf-ba4c-48b870291ba3'} May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:03.012164 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. May 10 20:57:03.013207 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:03.014133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] Returning 404 to user: Instance 4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:03.014133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ff95932f-ff74-483d-ab01-75e60a02e860 tempest-AttachVolumeNegativeTest-1824481913 tempest-AttachVolumeNegativeTest-1824481913-project] 10.222.0.65 "GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3" status: 404 len: 111 microversion: 2.1 time: 0.252458 May 10 20:57:03.014133 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1351/2003] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 20:57:02 2022] GET /compute/v2.1/servers/4c370a2b-a8cd-4cbf-ba4c-48b870291ba3 => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:57:08.363900 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b9c077c-72ca-4c42-b5c6-9d4d18313fe2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53076. May 10 20:57:08.463486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-52e73de7-c7bb-47f7-bead-d6ad93b7c281 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Action: 'create', calling method: .version_select at 0x7f6028f31940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1017841085"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:57:09.124626 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-52e73de7-c7bb-47f7-bead-d6ad93b7c281 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.772154 May 10 20:57:09.125396 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1352/2004] 10.222.0.65 () {60 vars in 1154 bytes} [Tue May 10 20:57:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 774 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 10 20:57:09.136348 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-213e7ab4-92eb-4be8-b6ff-6726f4d3f201 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602909c040>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:09.187409 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-213e7ab4-92eb-4be8-b6ff-6726f4d3f201 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 200 len: 345 microversion: 2.1 time: 0.054811 May 10 20:57:09.187986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1353/2005] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:57:09 2022] GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:10.200219 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cf830c57-42e0-44c8-8392-a82551109726 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602e21ef70>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:10.245331 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cf830c57-42e0-44c8-8392-a82551109726 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 200 len: 346 microversion: 2.1 time: 0.049307 May 10 20:57:10.245902 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1354/2006] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:57:10 2022] GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:10.256324 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-334c51ee-8d38-4eb1-b05d-ba83cef0631a tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Action: 'create', calling method: .version_select at 0x7f6028dd4820>, body: {"snapshot": {"volume_id": "2399cee8-c6a0-4dfb-b109-ebd11fd77d06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1707668153"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:57:10.664589 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-334c51ee-8d38-4eb1-b05d-ba83cef0631a tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.411698 May 10 20:57:10.665175 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1355/2007] 10.222.0.65 () {60 vars in 1161 bytes} [Tue May 10 20:57:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:10.674655 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2a76e258-e685-43f5-9d46-4e75b020f71e tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028f7aa60>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:10.702908 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2a76e258-e685-43f5-9d46-4e75b020f71e tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 287 microversion: 2.1 time: 0.031927 May 10 20:57:10.704187 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1356/2008] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:10 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:10.713203 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0788e3de-ada7-4b55-b4d8-c422b19a9a2d tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028f59a60>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:10.742851 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0788e3de-ada7-4b55-b4d8-c422b19a9a2d tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032996 May 10 20:57:10.743538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1357/2009] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 10 20:57:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:10.753046 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0790e096-327c-4588-b84b-e1af3737de5b tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602e21e8b0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:10.782712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0790e096-327c-4588-b84b-e1af3737de5b tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 287 microversion: 2.1 time: 0.032970 May 10 20:57:10.783308 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1358/2010] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:10 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:11.795060 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3bd54002-2490-4336-9b7c-266d667907fb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028f315e0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:11.824208 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3bd54002-2490-4336-9b7c-266d667907fb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 287 microversion: 2.1 time: 0.033300 May 10 20:57:11.824869 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1359/2011] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:11 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:12.836609 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d7b4359a-67d8-4509-947c-144ebf0e9caa tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602e21e9d0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:12.865098 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d7b4359a-67d8-4509-947c-144ebf0e9caa tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 287 microversion: 2.1 time: 0.032884 May 10 20:57:12.865653 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1360/2012] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:12 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:13.877629 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-04d7576c-e07f-4f4d-b136-042fcf11a5e4 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028f7a550>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:13.906627 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-04d7576c-e07f-4f4d-b136-042fcf11a5e4 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 288 microversion: 2.1 time: 0.033683 May 10 20:57:13.907320 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1361/2013] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:13 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:13.916679 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c642374f-b2d9-4bf6-946b-8d11c857a0af tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028eb80d0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:14.027630 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c642374f-b2d9-4bf6-946b-8d11c857a0af tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 202 len: 0 microversion: 2.1 time: 0.114280 May 10 20:57:14.031588 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1362/2014] 10.222.0.65 () {58 vars in 1253 bytes} [Tue May 10 20:57:13 2022] DELETE /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:57:14.036215 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32ced9d7-2324-4476-80b7-9393b0939342 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f60291a3af0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:14.065022 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-32ced9d7-2324-4476-80b7-9393b0939342 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 200 len: 287 microversion: 2.1 time: 0.032340 May 10 20:57:14.065591 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1363/2015] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:14 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:15.076673 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f4d1ef05-df5f-4a4e-b3b2-6c21371468bb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602e21e280>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:15.100069 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-f4d1ef05-df5f-4a4e-b3b2-6c21371468bb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] HTTP exception thrown: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f4d1ef05-df5f-4a4e-b3b2-6c21371468bb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Request method failure captured: May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 HTTP/1.1 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABietGkyOevRmIVyC7QkULptGM3iyvWFMUOx9z0rFRQDwNgGPiMX5u8vpY4iK6SVnZyUrqe5VqRCly5HEaaFVHYjhP0KjYdegFSCY9wAsIBm2IhbUbXcD0d69LgONVRNJPfwqHtgdQRHuAbPHDVfUP6rN55yhVk0mwYcVafMlhoAJiG4z0 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:15.102337 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72ba145b02734605a3dfee6533c82fe3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 628e2548877349f78ce1cd7cb0a1e2b5 May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': 'db58ae05-9ee7-4cd0-a983-39c27b515ca9'} May 10 20:57:15.104955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. (HTTP 404) (Request-ID: req-2731538a-948a-49e0-ac88-79234bc4a62c) May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.105688 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:15.106720 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 20:57:15.107991 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f4d1ef05-df5f-4a4e-b3b2-6c21371468bb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Returning 404 to user: Snapshot db58ae05-9ee7-4cd0-a983-39c27b515ca9 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:15.109955 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f4d1ef05-df5f-4a4e-b3b2-6c21371468bb tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9" status: 404 len: 111 microversion: 2.1 time: 0.031482 May 10 20:57:15.110839 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1364/2016] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 20:57:15 2022] GET /compute/v2.1/os-snapshots/db58ae05-9ee7-4cd0-a983-39c27b515ca9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:57:15.113886 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5cd33ebc-443b-43b8-8f58-782049e5abca tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602909caf0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:15.284696 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5cd33ebc-443b-43b8-8f58-782049e5abca tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 202 len: 0 microversion: 2.1 time: 0.175780 May 10 20:57:15.285283 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1365/2017] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:57:15 2022] DELETE /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:57:15.293153 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d82eccd3-1287-466d-b363-c5223c7e67d7 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6028f7a670>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:15.344986 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d82eccd3-1287-466d-b363-c5223c7e67d7 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 200 len: 345 microversion: 2.1 time: 0.055229 May 10 20:57:15.345379 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1366/2018] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:57:15 2022] GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:57:16.359370 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0c9948b0-4823-4b25-a3d4-691b6539ce32 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602905bee0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:16.387401 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-0c9948b0-4823-4b25-a3d4-691b6539ce32 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] HTTP exception thrown: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0c9948b0-4823-4b25-a3d4-691b6539ce32 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Request method failure captured: May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 HTTP/1.1 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABietGkyOevRmIVyC7QkULptGM3iyvWFMUOx9z0rFRQDwNgGPiMX5u8vpY4iK6SVnZyUrqe5VqRCly5HEaaFVHYjhP0KjYdegFSCY9wAsIBm2IhbUbXcD0d69LgONVRNJPfwqHtgdQRHuAbPHDVfUP6rN55yhVk0mwYcVafMlhoAJiG4z0 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:16.389535 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72ba145b02734605a3dfee6533c82fe3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 628e2548877349f78ce1cd7cb0a1e2b5 May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '2399cee8-c6a0-4dfb-b109-ebd11fd77d06'} May 10 20:57:16.390712 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. (HTTP 404) (Request-ID: req-ff20197f-0a64-4d50-a406-daa9822974be) May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.391389 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:16.393006 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:57:16.393944 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0c9948b0-4823-4b25-a3d4-691b6539ce32 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Returning 404 to user: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0c9948b0-4823-4b25-a3d4-691b6539ce32 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 404 len: 109 microversion: 2.1 time: 0.035854 May 10 20:57:16.394929 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1367/2019] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:57:16 2022] GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:57:16.406042 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3732949d-7e6b-4c9a-bc03-aa1c0f1ec711 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f602905b280>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:16.432410 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-3732949d-7e6b-4c9a-bc03-aa1c0f1ec711 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] HTTP exception thrown: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3732949d-7e6b-4c9a-bc03-aa1c0f1ec711 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Request method failure captured: May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 HTTP/1.1 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABietGkyOevRmIVyC7QkULptGM3iyvWFMUOx9z0rFRQDwNgGPiMX5u8vpY4iK6SVnZyUrqe5VqRCly5HEaaFVHYjhP0KjYdegFSCY9wAsIBm2IhbUbXcD0d69LgONVRNJPfwqHtgdQRHuAbPHDVfUP6rN55yhVk0mwYcVafMlhoAJiG4z0 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:16.434405 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72ba145b02734605a3dfee6533c82fe3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 628e2548877349f78ce1cd7cb0a1e2b5 May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '2399cee8-c6a0-4dfb-b109-ebd11fd77d06'} May 10 20:57:16.435726 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. (HTTP 404) (Request-ID: req-233b76e4-fd40-43ef-a4f2-6938ff96c418) May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.436538 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:57:16.437748 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:57:16.439678 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3732949d-7e6b-4c9a-bc03-aa1c0f1ec711 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Returning 404 to user: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3732949d-7e6b-4c9a-bc03-aa1c0f1ec711 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 404 len: 109 microversion: 2.1 time: 0.034067 May 10 20:57:16.440877 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1368/2020] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 20:57:16 2022] DELETE /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:57:16.444487 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b609c2d5-edbd-4ae6-a4b8-c703eb95f0b9 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Calling method '.version_select at 0x7f6029de5940>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:57:16.471413 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-b609c2d5-edbd-4ae6-a4b8-c703eb95f0b9 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] HTTP exception thrown: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b609c2d5-edbd-4ae6-a4b8-c703eb95f0b9 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Request method failure captured: May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 HTTP/1.1 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept: application/json May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Connection: close May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Length: 0 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Content-Type: application/json May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Host: 10.222.0.65 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABietGkyOevRmIVyC7QkULptGM3iyvWFMUOx9z0rFRQDwNgGPiMX5u8vpY4iK6SVnZyUrqe5VqRCly5HEaaFVHYjhP0KjYdegFSCY9wAsIBm2IhbUbXcD0d69LgONVRNJPfwqHtgdQRHuAbPHDVfUP6rN55yhVk0mwYcVafMlhoAJiG4z0 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Id: None May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Domain-Name: None May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Role: member,reader May 10 20:57:16.473327 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Roles: member,reader May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72ba145b02734605a3dfee6533c82fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72ba145b02734605a3dfee6533c82fe3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 72ba145b02734605a3dfee6533c82fe3 May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314438957 May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Id: 628e2548877349f78ce1cd7cb0a1e2b5 May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314438957-project May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: method: May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: exception: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: action_args: {'id': '2399cee8-c6a0-4dfb-b109-ebd11fd77d06'} May 10 20:57:16.474486 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. (HTTP 404) (Request-ID: req-c4947b13-2623-48cf-bd52-6c6a2738de98) May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.475112 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:57:16.476198 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:57:16.477096 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b609c2d5-edbd-4ae6-a4b8-c703eb95f0b9 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] Returning 404 to user: Volume 2399cee8-c6a0-4dfb-b109-ebd11fd77d06 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b609c2d5-edbd-4ae6-a4b8-c703eb95f0b9 tempest-VolumesSnapshotsTestJSON-314438957 tempest-VolumesSnapshotsTestJSON-314438957-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06" status: 404 len: 109 microversion: 2.1 time: 0.033991 May 10 20:57:16.478270 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1369/2021] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 20:57:16 2022] GET /compute/v2.1/os-volumes/2399cee8-c6a0-4dfb-b109-ebd11fd77d06 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:58:41.428975 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:58:41.429636 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 20:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:00:11.049723 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:00:11.050421 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 21:00:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:00:16.085958 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:00:16.086575 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 21:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:02:01.437158 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:02:01.437687 dv-cinder-828805-2-iscsi devstack@n-api.service[117754]: Tue May 10 21:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!